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Prefaiie 



The studies contained in the two volumes of this report 

(AN INVESTIGATION OF SECOND- LANGUAGE TEACHING and SECOND- 

LANGUAGE LEARNING) were possible only through the help we 

received from many quarters;. 

Scores of language teachers supplied the data contained 

in* the following pages. In some instances our demands on them 

were slight, requiring only the administration of the tests 

and the return of the data. In other cases our collaborators, 

especially the directors of experimental programs, devoted 

many hours to our interests, preparing statements about 

their programs, gathering supplementary data for us, and 

otherwise making possible a more complete account. It would 

be impossible to attempt to distribute appropriate specific 

acknowledgements over so wide a range of indebtedness. We 

can only express our obligation and thanks to all collectively. 

During the investigation, Edna Davis, Yolanda Leite, and 

Hazel Mitchell worked for long periods with the_ staff in 

Chicago, and Alice i\nn Chambers and Einar Ryden worked at 

Northwestern Univer.sity. In addition to the acknowledgements 

of their work made in the appropriate places throughout the 

volumes, we wish to thank them here for their efforts. The 

same is true of research assistants who worked for shorter 
fA 

periods at the various experimental centers 

We owe a particularly great debt to Lucas T. Clarkston 
for the conscientious care with which he scored the masses 
0 of tests and carried out the statistical analyses. 
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Our colleagues Ralph W. Tyler, the director, and Hugh 
R. Walpole, have, of course, contributed at every stage of 
the project; and their suggestions, both major and minor, 
in regard to these reports have done much to improve them. 
Needless to say, our colleagues cannot be held responsible 
for the statements and conclusions we advance here. 

Finally, the whole undertaking was possible only because 
of a generous grant by the Rockefeller Foundation to the 
University of Chicago. 

Though we divided the responsibility for preparing the 
original draft of this volume, we have subsequently worked 
over all the material together, and the present statement 
represents the views of us both. 

We are grateful to Henry Holt and Co. for permission to 
quote from Leonard Bloomfield's Language and to The University 
of Michigan Press for similar permission regarding C, C. Fries' 
Teaching caul Learning English as a Foreign Language, 

Frederick B, Agard 
Harold B. Dunkel 
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Chapter I 



The Purpose of the luvestigatiou 






Tlie time at which the Investigation of the Teaching of a 
Second Language was established, early in 1944, was a very 
significant one in the recent history of language teaching. 
The Modern Foreign Language Study of the 1920’ s had given 
great impetus to further activity, both on the part of those 
who accepted the recommendations of the "Coleman Report" 
and on the part of those who rejected it. 

The Second World War further vitalized language teaching. 
When hostilities were still only imminent, it was obvious 
that America was linguistically unprepared for a global war. 
To remedy this defect, the American Council of Learned 
Societies, with the co-operation of the Linguistic Society 
of America, set up a program of intensive language courses. 
Though these were devoted in large part to those languages 
which had heretofore been little studied, workers in this 
program were convinced that the general procedure had impor- 
tant implications for the study of all languages, including 
those which had been taught in our schools for many years. 
Intensive courses were, consequently, offered in the familiar 
languages of western Europe as well as in the more exotic 
tongues. 

After America entered the war, the Army Specialized 
Tr aining Program (ASTP) in language-and-area and other 
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schools established by various governmental departments and 
agencies carried on similar work. These developments have 
already been reported in detail elsewhere. Here we need 
only to sketch the important influence which all this ac- 
tivity, particularly the ASTP, had on language teaching 
generally. Because the ASTP was carried on in more than 
fifty colleges and universities, hundreds of language in- 
structors taught in it, and many younger language teachers 
studied under the system while serving in the armed forces. 
One of the most stimulating factors in ASTP was that though 
the Army suggested a general methodology, much was left 
tO' the ingenuity 'and resourcefulness of local staffs. Within 
the broad limits of the Army directives, there was great 
latitude for experiment and innovation, an opportunity of 
which many language staffs took advantage. Even those re- 
quirements imposed by the directives stimulated language 
teaching because they created a new situation. To mention 
two aspects of this change, most language teaching had aimed 
primarily at a reading knowledge of the language and had 
occupied three to five class hours per week of the student’s 
time. The Army, on- the contrary, was interested almost exclu- 
sively in having the student able to speak the language and 
to understand it when spoken to him; and for this training 
it provided approximately seventeen hours weekly. It is no 
wonder, then, that this almost revolutionary setting, along 
with the suggestions contained in the recommended methodology, 
set many language teachers to rethinking familiar problems. 
Many of them concluded that certain elementc of the Army 
program should be transferred to civilian instruction; and 
at the time the Investigation began, many colleges were 
planning more or less elaborate efforts to apply the ex- 

J. Matthew, Language and Area Studies in the Armed Services, Washing- 
ton: The American Council on Educetiong 1947# P. A. Angiolillog Armed 
Forces* Foreign Language Teaching, New York: S. F, Vannig 1947. 
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perience gained through ASTP to peacetime teaching as soon 
as it could be resumed. 

The military programs were not the only force vitalizing 
language teaching* though their size probably made them the 
best known and most influential. In the Southwest* the increase 
in the Spanish- speaking population had confronted several 
states with a problem of communication among their citizen."*; 
and they had accepted the challenge of teaching both Spanish 
and English as second languages in the elementary schools. 
Hiese attempts at a lower educational level than was commonly 
the scene of language teaching had raised new questions and 
had resulted in experiments with materials, methods, and de- 
vices. The teaching of English as a foreign language had also 
begun to come into its own after being treated as something 
of a stepchild for many years. ^ 

These are only a few of the factors which were producing 
changes in language teaching at the time our Investigation 
began. It seemed a likely moment for an attempt tc sunvnarize 
the experience gained from al.l these enterprises — not a 
historical account, but rather an analysis of the general 
principles and specific procedures which would represent what 
had been learned. As was intellectually healthy, considerable 
controversy had arisen about these programs. Some believed 
that the experience derived from these courses ought to 
revolutionize all language instruction. Others felt that 
these special programs had been carried on in unusual circum- 
stances which would not be reproduced elsewhere and hence 
that any new insights, however sound, would not be generally 
useful. Still others were inclined to echo the famous book 
review and to insist that the new things in these programs 
were not good and the good things not new. Unfortunately this 
controversy could not be resolved by evidence. For various 

2 , 

Further details will be found in Chapter VII. 
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reasons few objective data were available regarding the 
accomplishments of ASTP, and the personal estimates of 
different observers varied. Likewise the teaching of English 
had been carried on largely within the confines of a partic" 
ular institution or system of instruction, and no comparative 
evidence from impartial sources existed. 

This situation could, however^ be remedied. At the time 
the Investigation began, there was an unprecedented interest 
in language teaching and language learning, an interest which 
even spilled over into the popular periodicals. With the end 
of the war in sight, many teachers and colleges were planning 
experiments in modifying and adapting the techniques of ASTP 
to civilian instruction. The tide of foreigners seeking to 
learn English here or in their own countries was rising ever 
higher. A time when* so many unusual language programs would 
be in action appeared a good one in which to attempt to 
Secure objective evidence on some of the questions which had 
been raised. 

This timing of the Investigation affected the nature of 
the study and its findings. Starting work in 1944 as the ASTP 
was about to end, we were able to follow the new developments 
and experiments as soon as they were instituted in the 
academic year 1944-1945. More work was possible in 1945-1946 
as more colleges and other centers of language teaching 
recovered from their wartime alterations and put new programs 
into operation. This was the heyday of language experimenta- 
tion. In 1946-1947, as the horde of postwar students de- 
scended upon the colleges, many of the experimental programs 
(which nade heavy demands on staff, classroom space, and 
other overtaxed facilities) had to be abandoned. 

Yet the period during which we worked also had obvious 
di<iadvantages . The wartime and postwar difficulties in 
securing staff, materials, clerical help, transportation, and 
nearly everything else, immeasurably hindered the work of 
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both the Investigation and the teaching programs. So, for 
example, railroad and coal strikes twice coincided with 
important testing periods, and the consequent restrictions 
and delays deprived us of irreplaceable data. More im- 
portant was the fact that we covered experiments in their very 
early stages. Even if the materials and procedures developed 
for the ASITP did not need much modificatioa before they could 
be used with ordinary high school and college students 
(a point about which there was considerable debate), time is 
required for organizing any new program and getting it 
"shaken down." We may have examined experimental foreign- 
language courses too soon to get a fair picture of what ’S 
ultimately possible, but in most cases this early period is 
the only one for which evidence is available. Possibly the 
first impetus and enthusiasm which attended these under- 
takings made this handicap less severe than might be ex- 
pected. We can, at any rate, report what was accomplished. 



DESIDERATA FOR AN ADEQUATE STUDY 
The circumstances under which the Investigation operated 
suggested rather clearly the problems about which its work 
should center and hence the general outline of this report. 
Possibly the best way to set forth what was involved is to 
begin by stating the desiderata for a technically adequate 
study. We can then indicate the points at which our present 
investigation meets or falls short of these requirements. The 
shortcomings are particularly important. For one thing they 
indicate the reservations which must be kept in mind in 
examining the data we secured. Of still greater importance is 
the fact that many o£ these difficulties can be overcome 
only by the co-operative effort of all language teachers and 
hence a more definitive study is impossible until more work 
has been done in certain areas. 



1 



AN INVESTIGATION OF SECOND-LANGUAGE TEACHING 



ERIC 



I. Adequate Coverage 

A language investigation should cover a wide number of 
cases. Only by such broad coverage can it be certain of 
surveying the full range of possibilities offered by varied 
or conflicting hypotheses. Extended exploration can also make 
certain that the best and the most advanced programs have 
been covered as well as the run-of-the-mill variety. Both 
sorts of information are important. While one should know 
what can be achieved by the best programs under the most 
favorable circumstances, one should not lose sight of the 
accomplishment of language teaching as a whole and assuim? 
that these outstanding examples are typical of what is or can 
be dtMie everywhere. 
n. A Clear Statement of Objectives 

Only in comparison with the aims which language teaching 
seeks can the degree of its achievement or the effectiveness 
of its procedures be judged. The objectives must be stated 
with such clarity and specificity that the attainment of them 
can be accurately measured and that general agreement can be 
reached, not only concerning the nature of the objectives 
sought, but also in regard to success or failure in achieving 
them. As for specificity, statements of objectives must find 
some middle ground between two extremes. "Teaching the 
student to speak Spanish" is, on the one hand, too general 
to be useful. We must have a more precise definition of what 
degree of oral command is meant.’ On the other hand, stating 
that certain materials must be covered or a certain test must 
be passed leaves the objectives too narrow or particularized. 
There must be some clear relation statable between the 
mastery of these specific materials and the larger aim of 
speaking Spanish. 

2ET. Clear Statement of Assumptions and Principles 

The assumptions indicate why the objectives have been 
considered desirable and feasible, and the principles show 
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the logic underlying the specific procedures adopted in the 
course. Together the principles constitute a philosophy of 
language teaching. 

JV* A Detailed Record of Procedures , 

Before a program can be the source of meaningful informa- 
tion, the procedure followed in it must be clear. Skeptics 
often claim that classes are different in name but not in 
activity. Certainly we have observed reading classes in which 
very little reading was done and oral classes in which no 
student spoke. The label is scarcely sufficient warrant for 
classification. Furthermore, if a group shows outstanding 
achievement, an investigation is primarily interested in 
discovering hypotheses which may explain its success. These 
hypotheses can be obtained only from a clear record of the 
training the class has had. 

V. Accurate Measurement 

An investigation assumes the existence of accurate tests 
and other devices for measuring the attainment of ail im- 
portant objectives. These must be valid and reli’able instru- 
ments which give exact comparative data on the achievement 
of various objectives by contrasting procedures. 

VI. Control of Non- Unguis tic Variables 

Accurate measurement implies that non- linguistic variables 
are adequately controlled and that different results are 
attributable to the success or failure of the methods and 
materials used and do not rest primarily on other factors. Or, 
if these factors are closely related to language learning, 
their effect should be accurately measured. 

Vn. Hypotheses 

As a result of the procedure outlined in the foregoing 
paragraphs, a series of hypotheses should emerge. These 
hypotheses could involve any of the points in this list. 
They might, for example, indicate that certain objectives 
were not obtainable, that certain principles were not 
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sound, that certain procedures were not effective, and so on. 
Situations would thei be found or set up which would allow 
these tentative hypotheses to be tested in still more 
tightly controlled situations so that further evidence of 
their validity could be obtained. 

VM. Conclusions 

From the foregoing process certain conclusions (even if 
only of a tentative nature) should appear. These toomight apply 
to any of the steps in the process. One could see how well 
certain objectives were being obtained, what procedures 
seemed more or less effective in producing given results, and 
the like. Scarcely less important than the actual conclusions 
would be the isolation of questions for further clarifica- 
tion, problems for further study, and hypotheses for further 
testing. 



THE PRESENT INVESTIGATION 

Our investigation was unable to meet all of these criteria 
perfectly. As we have indicated, the statements of the 
difficulties we encountered will be particularly valuable in 
indicating the need for further work. This list may also 
serve as a warning of points to be kept in mind when reading 
or hearing the many ex cathedra pronouncements commonly made 
concerning the success or failure of individual programs. 
J. Coverage 

We attempted, by letter and personal visit, to secure the 
co-operation of as many individuals and institutions as 
possible. We sought to get in touch with all language programs 
of which we learned, by either hearsay or formal announcement, 
but some courses may have eluded us. We made repeated public 
announcements of our testing program and furnished the tests 
free to any who were interested in using them. In some cases 
our repeated inquiries remained unanswered. Sometimes after 
rather prolonged consideration, institutions decided not to 
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participate in the study. We cannot claim that our coverage 
is inclusive. We believe^ however, that the stronger language 
programs were generally interested in demonstrating their 
success and in seeing how they compared with other efforts. 
We think that there were few, if any, very confident programs 
which failed to supply us with data. Even the students whose 
scores we took for comparative "norms" (who were not par» 
ticipating in experimental programs) were probably the prod* 
ucts of the more interested and effective teachers. 

We sought to cover as wide an area of languages and of 
scholastic levels as possible. Too often pronouncements have 
been based on experience obtained with a particular type of 
student, at a particular level of education, in a particular 
local situation, or under other specific circumstances. We 
wished if possible to collect available thought and evidence 
on the general principles which underlie all language teaching 
and learning. Since the colleges had been particularly 
stimulated by the work of ASTP, the bulk of our material 
concerns attempts of various institutions to adapt various 
features of this program to their regular instruction. 
The high schools, in general, seem to have awaited the results 
of the colleges’ experience before undertaking similar ex* 
periments, and we secured relatively little evidence from 
them and from lower educational levels. For the upper levels 
of language instruction we were able to use the foreign 
students studying English in thi.s country. Although many of 
them came with little background in English, most of them had 
two or more years instruction , in their native country and 
hence represented roughly the level 'immediately above that of 
foreign-languages students here. We also worked with certain 
other groups wherever possible, but the bulk of our -material 
involves these two classes of students. 

We were also forced to limit the number of languages with 
which we worked. At the time the Investigation began, the 
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possibilities of civilian instruction in Chinese, Japanese, 
and the othor less cominonly taught languages were still 
uncertain; hence, in order to secure numbers of students 
sufficiently large for meaningful results and to limit the 
time and labor devoted to test construction, we concentrated 
on English, French, German, Russian, and Spanish. Even for 
German and Russian we found it difficult to secure large 
groups. 

IT. Objectives 

The objectives of many courses still lacked sufficiently 
precise definition. In large part, this vagueness was due to 
the fact that only recently have the aural-oral skills been 
generally emphasized. After many years of working with the 
reading objective, some consensus has been developed as to 
how reading ability can be specifically defined. The aims of 
speaking and aural comprehension show much greater diversity 
of interpretation and a greater variety in the materials used 
to achieve them. This fact caused us great difficulty in 
selecting programs and in choosing or constructing instruments 
which would accurately measure these important aims. The next 
two chapters on objectives and on the testing program will 
illuminate these problems in greater detail. 

Iff. Statements of Principles 

Actual classroom procedures frequently are followed because 
of habit or convenience, not because they have been judged 
sound means of achieving the objectives sought. Likewise, in 
many instances the objectives presupposed conditions which 
were not met by the school or by the student for whom the 
course was intended. It is a truism in the teaching profes- 
sion that the best practitioners are often weak in theory, 
particularly in stating their own theory. We culled the 
literature and also asked some outstanding workers in the field 
to supply us with statements applying to their particular 
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courses. We have clarified some issues here, but ambiguity at 
this point still makes it difficult to discuss many ex- 
perimental programs. 

IV. Procedures 

In the case of some classes whose progress we followed 
most closely, members of our staff or observers hired by us 
recorded the classroom activities in detail, and an exact 
record is available. Yet this technique (like that of personal 
observation by the staff) was obviously too costly in both 
time and money to be used in more than a few instances, and 
we have usually had to be satisfied with much less precise 
information. 

K. Measurement 

As has already been mentioned, lack of clarity in regard 
to some of the objectives made precise measurement of them 
difficult or impossible. As usual, the task of selecting or 
developing a series of tests and other means of evaluation 
had the function of clarifying many of the linguistic issues 
involved in the experimental programs: the definition of 
speaking knowledge, the topics in which the student was to 
be fluent, the speed with which he was to speak and under- 
stand, and other major issues in teaching the aural-oral 
skills. For reasons which will be made clear later, it is now 
impossible to construct a set of aural or oral examinations 
which will be perfectly satisfactory to every one on all 
counts." 

VI. Control of Non^Linguistic Factors 

Data on many of these points is admittedly difficult to 
obtain under any circumstance: e.g., the effectiveness of the 
teacher (especially the reactions between his personality 
and the type of student found in that; particular class). But 
even for relatively objective materials, precise data were 
often hard to obtaitt. Many teachers and students failed to 
give the information requested. Sometimes when the information 
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was given, further checking showed that it was inaccurate. 
Even with the greatest possible care and trouble, the data 
available ran out before the theoretically desirable limit 
was reached. For example, some idea of the students’ general 
intelligence was highly desirable. Yet the variety of tests 
used by different institutions for this purpose, the number 
of transfer students, and the many individuals who somehow 
failed to take tests presumably required of all students, 
produced many cases forwhich satisfactory data were not 
available. The size of this group will be astonishing to 
anyone who has never sought to track down this kind of infor- 
mation. In any case, perfect control of these factors would 
be possible only for an organization which could dictate (to 
fifty or sixty institutions) the full detail of their entrance 
applications, placement tests, and registrar’s records. 
Similarly, it was impossible to control adequately the 
student’s previous experience with the language. Often 
registrar’s records did not cover incomplete courses or 
courses which had been failed. Likewise foreign residence or 
the opportunity to speak the language with family or friends 
could not be ascertained with the precision which was theo- 
retically desirable. None the less, for each of the programs 
we covered, we present such information as we could obtain. 
VE. Isolation and Testing of Hypotheses 

The Investigation was not to set up programs of its own 
but was to follow experiments already in existence. Conse- 
quently, the general organization of these programs, the 
testing of them, and their other elements were all dictated 
by the needs and interests of the institutions and staffs 
which carried them on. They were not designed primarily 
to develop and demonstrate specific principles of language 
teaching. Probably most language teachers believe that, in 
educational experiment, education should have precedence 
over experiment. None the less, the study of experiments so 
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organized and conducted inust inevitably result in less clear 
hypotneses and less conclusive results than could have been 
obtained under other conditions. 

VM. Drawing Conclusions 

A major obstacle to complete decisiveness of the findings, is 
the lack of wholly adequate standards of comparison. In most 
instances nonoexperimental groups existing at institutions 
which also carried on experiments differed so markedly in 
type of objective, student, materials, and other respects that 
their effectiveness as "controls" is very slight. We sought 
to overcome this difficulty in part by securing a general 
standard of performance or set of norms, which will be de- 
scribed in Chapter IV. Hhough comparisons on this basis con° 
tribute important information, they do not demonstrate con-; 
elusive ly what would have been possible under, different 
procedures but. with clearly equivalent student body, teaching 
staff, and other facilities. Not only were these comparisons 
in cross-section lacking; longitudinal comparisons those 
with earlier groups of students trained by other methods at 
that same institution — were likewise wanting. Few institu- 
tions had adequate records of this sort. Though some of them 
had regularly used the Co-operative or other reading tests, 
none had sufficient data on aural or oral achievement, either 
on such standardized measures as the Lundeburg-Tharp tests or 
on homemade batteries for which local standards had been 
developed. Some further causes of difficulty in obtaining 
conclusive results will be indicated in the following chapters. 

The work of the Investigation demands two different, though 
closely related, presentations. The first treats primarily the 
various experimental programs, considered not;only as in^ 
dividual undertakings but as a general movement in the field 
of language teaching. Since their achievement cannot be 
examined in a vacuum but must be viewed against the back- 
ground of the general language situation, such a study must 
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also consider the general level of attainlment. The data 
derived from the experimental programs as well as from the 
more conventionally trained groups, the means used for ob- 
taining this evidence, and the conclusions to be drawn from 
it are, consequently, the subjects of this first volume of our 
report. 

But all this theorizing, experimenting, and testing has 
implications far beyond the particular experimental trends 
with which it was directly concerned. This activity has con- 
tributed to our general store of knowledge about the funda- 
mental principles and problems of language teaching and 
learning. In addition to this evidence gathered from practical 
work in the classroom, the Investigation was also able to 
carry on some studies of specific problems under fairly well 
controlled conditions. These various findings too cannot be 
considered in' isolation but must be fitted into our existing 
information. Consequently, the other volume of this report, 
SECOND- LANGUAGE LEARNING, summarizes our knowledge of lan- 
guage ' teaching and language learning as it exists in the 
present stage of this experimental epoch, enriched by the 
hypotheses and evidence produced in recent years. 



Chapter II 



^ihe Objecliyet of Language Teaching 



Hhie objectives of language teaching are fundamental to any 
consideration of it, for discussions of procedures, texts, 
results, and all the rest can be meaningful only in relation 
to the ends sought. Objectives are particularly important for 
conrparisons between the "newer" language programs and their 
predecessors because the fundamental difference between the 
two types of ccmrses lies in their objectives. 

Comparisons between the "old" and the "new" courses may, 
however, tend to imply that each type is more homogeneous than 
is actually the case. Not all language teachers accepted the 
findings and recomnendations of the Coleman Report; and even 
those who sought to follow it produced very different courses. 
The "reading method," the "direct method," the "all°purpose 
course," and half-a-dozen ethers existed side by side, and 
very different programs were to be found Under any one of 
these labels. Thus the "old" or "traditional" course was ac- 
tually a motley array of rather different ones. The "newer" 
course is equally varied. The AS11P itself, though based on 
the army’s general directive, was a collection of highly in-» 
dividualized adaptations and experiments as it actually ex- 
isted at various colleges and universities; and the civilian 
programs developed from it have been no less diverse. 

In spite of this diversilby of both the "old" and the "new" 
courses, it is still possible to find in their objectives a 
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m^or point of difference between the two general types. No 
scheme for classifying objectives is ever wholly satisfactory 
but for the moment the following distinction is useful. In one 
group of objectives may be classed the efforts to impart the 
basic linguistic skills: reading, writing, speaking, and aural 
comprehension. In the second group can be placed those larger 
objectives for which the language skills serve as means. A 
wide variety of outcomes has been listed here: disciplinary 
training in neatness, accuracy, and logical thought; increased 
understanding of the nature of language as a means of communi- 
cation and as a tool of thought; a better command of one’s 
native language; a knowledge of the foreign people’s history, 
culture and civilization, especially a knowledge of the for- 
eign literature; increased international understanding and 
good will; the development of historical and cultural per- 
spective, and many others. 

As far as this second group of objectives is concerned, 
comparisons between the "old" and "new" courses can have 
little solid foundation. Such comparisons have been made. For 
example, some critics of the "newer" courses have asserted 
that any superior achievement as regards the first set of ob- 
jectives in these courses has been attained only at the 
expense of this secmnd type. Yet there are no generally ac- 
cepted standards by which to measure achievement in regard 
to this second class of objectives, and there seems likely 
to be none for some time. To take a typical example, "knowl- 
edge of the foreign culture und civilization" is an aim often 
stressed. Many teachers insist that they give considez'able 
attention to it, and the publishers’ blurbs for most texts 
make similar claims. Yet one has only to read the articles 
or listen to the speeches about this objective to realize that 
there are as many interpretations as there are authors and 
speakers and that language teachers are far from any agreement 
on what they intend by "culture and civilization." Oh the one 
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hand, some mean "knowledge of the location of important 
cities, rivers, and districts," but others seem to have in 
mind a mystic empathy with the soul of the people. Discus- 
sions of "culture and civilization" tend, consequently, to 
break down in complete confusion because of either failure 
to define the terms at all or unwillingness to accept the 
definitions offered by others. 

Under these circumstances our examination of language 
programs could not take into account this second class of 
objectives. This inability reflects a grave weakness in all 
language teaching and one which needs to be remedied. Since 
these objectives are the reasons for teaching the linguistic 
skills, language teachers should define them more precisely 
and be able to present better evidence that their students 
are attaining them. Meanwhile, comparisons between the two 
types of programs must rest solely tm the different objectives 
chosen among the linguistic skills and on the various degrees 
of success achieved in imparting them. 

Among the linguistic skills the newer courses, almost 
without exception, give greater emphasis to the oral-aural: 
the ability to speak the language and to understand it when 
spoken. All the other much-discussed features of these pro- 
grams (informants, phonemic transcriptions, increased contact 
hours, smaller sections, and the rest) are simply means 
(xice speaking ability has been adopted as a primary cibjective 
— of achieving this, end. Provided the ability to speak is 
accepted as an important aim, many of these devices are ob- 
viously sound means to it. The contention will hardly be 
doubted, for example, that smaller sections, which give each 
student a greater individual share in the class’s total time, 
will produce greater speaking ability. Other matters, like 
the phonemic transcription, will be subject to more debate. 
But the success or failure of the individual devices is im- 
portant only in proportion to the emphasis placed on the ob- 
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jective which they serve, the ability to speak the language. 
The value of the oral-aural skills as primary objectives in lan- 
guage teaching thus becomes the basis of all further discus- 
sion — particularly, the relative emphasis to be given these 
skills in comparison with the other objectives of language 
teaching. 

Possibly the best way of examining the contrast between 
the objectives of the older and newer courses is to begin by 
considering why the traditional courses did not stress oral 
and aural uses of language. These reasons can conveniently 
be divided into two classes. In the first are reasons vdiy it 
was felt that the oral-aural skills could not be taught in 
regular educational programs even though they might be con- 
sidered desirable. In the second group are the arguments for 
deciding that the oral-aural skills should not be taught as 
important objectives for language instruction. In opposition, 
the "newer" courses rest on the beliefs (a) that the problems 
or difficulties in teaching the oral-aural skills can be 
avoided or overcome, and fb) that certain changes in the situ- 
ation now make oral-aural skills more important and desirable 
as educational objectives. 

The first reason advanced for minimizing the oral- aural 
skills, even though they might be desirable and important, 
was the lack of time. The two-year language course was, and 
still is, that elected by most high school and college stu- 
dents. Five hours per week for a school year of 33 we^ks prob- 
ably constituted a maximum for most institutions; this sched- 
ule exposed the student to the language for 330 hours during 
the two years. Many institutions, with courses running only 
three hours a week and with shorter school years, fell to as 
few as 200 hours for the two-year period. Tliis amount of con- 
tact was thought to be too short for imparting a speaking 
knowledge of the language. 

Whether or not this belief was sound, the army program and 
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the college courses developed from it have all provided more 
tine . For ASTP t a minimum of fifteen hours per week for 36 
weeks produced an impressive total. Though most adaptations 
have been unable to secure so large a block of time in civil- 
ian schedules, the newer programs are all marked by a rela- 
tive increase in the total number of hours. In some cases this 
change has meant only an increase from three hours to five; 
in others, the number per week has risen to eight or ten, with 
very few courses getting more than ten. Whether this much 
additional time (still small as compared with that available 
in ASTP) is enough to develop oral -aural skills is another 
question and one to which later pages of this volume will con- 
tribute information. 

A second cause for the traditional minimization of the 
oral-aural objectives was the customary size of language 
classes. To have thirty to forty students in a section was 
standard practice in nearly all high schools and was certainly 
not unknown in college classes. Yet if the entire class-hour 
were spent in speaking, each student would have a minute and 
a half at most hardly enough practice for gaining any de- 
gree of skill. The newer programs, by using informants or 
drill-masters, have drastically reduced the size of sections 
to six to twelve students and in this way have made possible 
three to six times as much individual practice per class hour. 

A third reason for avoiding the spoken language was the 
belief that many teachers, particularly at the lower educa- 
tional levels, were insufficiently trained in it themselves. 
At the worst, the teacher’s phonemic and intonation patterns 
were considered too poor to serve as models for students. At 
a slightly higher level, the teacher did not feel himself 
sufficiently fluent to be easy with oral-aural work. Yet there 
is a very real sense in which it is difficult for anyone who 
is not a native speaker of the language to handle an oral- 
aural course once it has progressed beyond the elementary 
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&i.ages. Subtle or idiomatic turns of expression present prob- 
lems for which only native speakers of the language have 
feeling. By providing drill-masters who are native speakers, 
the newer courses have avoided this difficulty. The native 
speaker may not be connpetent to teach his language, but he is 
a judge of how things are or are not said in it. 

A fourth cause for the earlier minimization of the oral- 
aural skills was the belief that the student had few oppor- 
tunities to hear the foreign language outside the classroom. 
Here the newer courses have utilized the record, the movie 
and the radiof as means (outside the classroom as well as in 
it) of enabling the student to hear some speaker other than 
the teacher and to come in contact with varied types of ma- 
terial. Ibese courses have also, done much to interest native 
speakers of the language (living in the community but not 
attached to the educational institution) in programs which 
permit the student to speak and hear the foreign language in 
social situations. Language houses end other means of this 
sort have been given renewed emphasis. 

To sum up, in regard to all the reasons advanced for be- 
lieving it impossible or very difficult to teach the oral- 
aural skills, the advocates of this approach have not so much 
denied these difficulties as they have sought to avoid or 
overcome them, and their innovations in procedure are best 
understood as specific means to these ends. 

There then remains the second set of arguments: the earlier 
reasons for believing that the oral-aural skills, even if 
teachable, should not be primary objectives of language in- 
struction. This argument is a question of relative, not ab- 
solute j value. All arguments favoring oral-aural work involve, 
either explicitly or infilicitly, a comparison with reading. 
Probably no one thinks that ability to speak and understand 
a foreign language is a dangerous or undesirable thing in 
itself. At the high school and college level certainly, the 
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possible psychological dangers of bilingualism or similar 
arguments against speaking a foreign language do not enter. 
Ihe question has always been: are the oral-aural skills a more 
educationally desirable aim than reading ability? 

The greater utility (educational or otherwise) claimed for 
reading rests on several points. One is that because reading 
is the easiest skill, it is the one which the student is most 
likely to acquire to a usable degree. In the attainment of 
any skill, a certain point of development must be reached 
before its possession is of much value. The student of piano, 
for example, who can play only The Brownies * Picnic finds 
that this much skill contributes little to himself or to 
others. His pianistic ability must reach what may be called 
a point of increasing returns. He can then at least make a 
stab at playing many of the things he wants to play and at 
accompanying singers or instrumentalists. The language skills 
resemble all other skills in that they too begin to produce 
returns only after a certain point of attainment has been 
reached; and past that point relatively small increases in 
skill produce greater returns in use and pleasure. 

As we have said, this fact was used as an argument for 
reading because it is the easiest skill. Heading requires 
only the passive recognition, not the active manipulation, 
of the linguistic symbols. The reader can go at his own pace, 
pausing or glancing back if he desires, and he can stop to 
consult dictionaries and grammars. Being thus the easiest 
skill, reading seems to be that which the average pupil is 
most likely to develop to a useful point. No less important 
is the claim that reading is a skill which the student can 
practice by himself and that consequently it is not so neces- 
sarily subject to "rust" once formal training has ceased. 
Heading has also been favored on the grounds that it is the 
skill which the American student is most likely to find either 
the need or the opportunity to use for education, vocation, 
or pleasure. 
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The rebuttal offered by the advocates of the opposite posi- 
tion does not attack all these points. In general they agree 
that the aural-oral command is more difficult of attainment 
than is reading skill; but they believe that by devoting a 
larger portion of the student's time to language work and by 
exploiting mechanical aids and other new resources ^ they can 
ovarcome this handicap and develop the student’s oral-aural 
ability to a point of increasing returns comparable to that 
he can attain in reading. Their denials concern chiefly the 
other two points and really rest on vdbat they believe is a 
change in situation. Living in one world and enjoying modern 
technological developments in transportation and communica- 
tion, the American student will no longer find (they claim) 
that reading is the skill which he has most opportunity to 
practice and use. They point to increasing vocational oppor- 
tunities for which oral-aural competence is indispensable or 
desirable as industry seeks world markets and international 
co-operation in political and other spheres increases. They 
foresee greater social and recreational contact with other 
peoples as air transport and radio communication knit the 
world more closely together. 

In addition to these claims of greater usefulness, they 
freqplently urge two additional points. They believe that more 
students can be better motivated to study a language if that 
involves speaking it rather than reading it. Further, they claim 
that the initial approach to language, whatever the ultimate 
skill Sought, is best made through the ear and tongue. Thus 
they believe that time spent in oral-aural work will increase 
reading ability within the same period of trainiiig.^ 



Tlh# skills eoold itand in ■■▼■ral diffarsBt ralationi. For oxiMpIa.^ 'tiM 
awral andl oral akilla could bo eonaidorod tba doninaat objaetiros, witb 
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waa adoptad by aoaa ^ailitary prograaai oaly oaa or two axtraaaly axpcriisaatai 
plaaa for c&TalaaB aaatract&oa bara adoptad it. Moat aducatioaal iaati tatioBa 
eoatiaaa to eaaaiao tba priaary iaportaaca of raadiag ability. Oral-aaral 
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If one wishes to examine these counter-claims in their 
turn, it is obvious that certain reservations or qualifica- 
tions must be made unless one is willing to adopt a complete] y 
partisan attitude. For example, vocational opportunities in 
language work have always existed, and there are probably more 
of them now than there were in the past. The question is 
whether they have so increased as to affect any large propor- 
tion of our high school and college populations and thus jus- 
tify any great educational change based on these grounds. 
Special training programs such as language schools, intensive 
sumtier courses, and the like can always be available for the 
needs of those professionally concerned with languages. Needs 
of this sort must affect many students before they become 
cogent educational arguments. 

Similarly arguments based on increased travel and communi- 
cations sometimes represent future predictions rather than 
present actualities. Ihanks to jet propulsion, air travel is 
rapid, but it is still so expensive that only a small segment 
of our population can indulge in it. Likewise, despite the 
five-day week, relatively few have vacations long enough to 
make extended travel possible. The same cautions can be urged 
in regard to radio communication. Short-wave is a fact, but 
how many people own a short-wave set? And not all present 
owners listen regularly — even to the BBC, for which no 
foreign language skill is needed. 



diYidl«ndI'° which the Btudent geti in addition to reeding ability. Even in the 
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For deciding issues of this sort, factual data on the 
actual nuimlber of people concerned and other matters would be 
of inestimable help in arriving at sound judgments. The war 
and postwar periods, during which the investigation operated, 
clearly could not furnish data which would be representative 
of the situation likely to prevail once the worst of the post- 
war dislocation is past. We did not, therefore, attempt to 
collect any such data. But if language teachers are going to 
use arguments of this sort, they should be ready to support 
them with evidence gathered fis soon as general conditions 
make it possible. 

The claim that greater emphasis on the spoken language 
produces better motivation in students likewise demands evi- 
dence as opposed to mere asseveration. There is a marked 
tendency for all of us to generalize our personal preference 
into a universal law. But motivation also suggests ^ another 
important issue, the need for diversity. Some students may 
be more attracted to- reading, others to speaking. In the best 
of all possible worlds, educational institutions would be 
able to present varied offerings which would meet the needs 
and interests of different types of students. Unfortunately, 
few institutions are able to offer a very wide assortment of 
courses. 

The fourth argument of the advocates of oral-aural training 
also demands careful consideration. It asserts that the spoken 
language serves as the best introduction to any other type of 
language learning. This argument, however, hinges on a ques- 
tion of degree, and unless this degree is indicated exactly, 
battles with straw men are likely to result. Few traditional 
classes made no use of- the spoken language.^ Probably most 

2]For example » advocatea of the "readinf method*^ alwaya atreaaed ”oral 
exerijiaea'^ thouigh theae were distingtmiahed from speaking ability* Cl. A* 
Coleman^ "A New Approach to Practice in Reading a Foreign Language i" Modern 
Language Jourml XV (1930) 10I-18; P. Magboldt, Language Learning (Chicago: 
UniTersity of Chicago Preaa» 1935) 44*5. 
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teachers believe that the student, in order to read, must be 
able tomake seme set of sounds to represent the words he sees. 
]^t reading with a consistent phonemic pattern is a long way 
from being able to carry on a conversation in the language 
like a native speaker. Likewise, some skill and practice in 
aural comprehension does not equal the ability to understand 
everything said. In the interval between the extremes, there 
are an infinite number of levels which teachers can consider 
the minimum of oral-aural proficiency necessary for the de- 
velopment of reading skills. To say that there should be an 
oral-aural base for reading is td say little; the important 
question is how extensive (specifically) this base can and 
must be. 

Both the layman and the professional language teacher some- 
times spedk glibly of "knowing" a language or "having a read- 
ing knowledge of a language" as if these abilities were 
unitary things which one either has or has not. Of course, 
in point of fact, knowledge of a language is a matter of 
degree, best represented as a line formed by a continuous 
series of points. At a given moment, any individual’s knowl- 
edge of a language is represented by one of these points as 
he moves along this continuum toward the final point, "com- 
plete mastery of the language." Actually this last point is 
at infinity and is never reached, for no one ever attains 
"ccxnplete mastery of a language," even of his own. When anyone 
speaks of "a reading knowledge of a foreign language" or 
"ability to speak like a native," he obviously does not refer 
to the last point in this line, but rather to_:some other 
point or cluster of points much nearer the center. 

Two difficulties are inherent in this situation. One is 
the problem of definition. When two people talk about "a 
reading knowledge, " one of them often means some point quite 
far to the left or elementary end of the line while the other 
has in imiiiid a point far to the right or advanced stage of 
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language proficiency. Many past controversies in the litera- 
ture have waxed hot as a result of this elementary semantic 
confusion. 

&it even after both parties have, so to speak, put their 
pencil-points on that- part of the line they are talking about 
and after the ref^ent of the term . "reading knowledge" is 
clear, there is still plenty of room for disagreement about 
the second problem: whether one party has put his standards 
too high or too low. When is the degree of ability sufficient 
to merit the title of "reading knowledge"? Before turning to 
the newer problems involved in "speaking ability" and "aural 
comprehension, " we do well to note the state, of affairs in 
regard to reading knowledge. Since this objective has been 
familiar for many years, language teachers have had consider- 
able experience in attempting to define it and to set stand- 
ards for it. The knowledge and , experience gained in regard 
to reading should be useful in doing similar work with the 
other skills. 

Though any attempt to generalize must be open to numerous 
(pialifications , comon practice seems to define a "reading 
knowledge" of the Indo-European languages somewhat as fol- 
lows.,,* The student can recognize approximately the first 
2,000 words in the frequency counts made of written material 
in the languages for which these studies are available. In 
morphology and syntax, likewise, he is expected to have a 
recognition knowledge" of the most ccration forms and gram- 
matical patterns. 

There then remains the .question of judging the definition 
or standard so set: what does this "reading knowledge" mean 
when applied to the actual process of reading? Here the impor- 

*Cf. A. I. Fmati, "Readiag Kaovledga Taat ia tlk<s Foreiga Laagatget: A 
SmrreY,'’Modern Lan^uagt Journal, XXIII (1939) 440>6; M. S. Pargaeat, "What 
Coaatitates a Raadiag Kaoviadge of a Foreiga Laaguage, aad How it cia be 
AehieTed^i, " French Review, XVII (1943) 74«82. 
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tint point to notice is that the standard is conventional in 

that the student will be able to read very little without 
further resources and practice. Few authors except textbook 
writers will ever compose many consecutive sentences using 
only the vocabulary, morphology, and syntax of highest fre- 
quency.^ mbough the student will get some added help from 
cognates and parallels to his native language, from the sense 
of the context and similar aids, ultimately he will have to 
turn to the dictionary and grammar. Thus the "reading knowl- 
edge" at its early stages gives the student only the ability 
to slog through materials With this much equipment he can 
begin to read in the language, and this experience will in- 
crease his familiarity with its vocabulary, grammar and 
syntax. If his reading centers primarily about a limited 
number of fields, this practice will ultimately give an ap- 
proximation to a complete knowlev^ge cf the language commonly 
used by writers in those areas. Without dictionaries, grammars, 
and this additional practice, however, the "reading knowledge" 
amounts to little.' As hti\s often been pointed out, the grad- 
uate student who requires an hour to work through a page will 
never have the foreign literature of his subject at his 
fingertips. He must get additimial practice and greater speed 
in reading before the "reading knowledge," as commonly defined 
and taught., means "being able to read." Because of the exist- 
ence of the frequency counts and the relation between them 
and the usual definitions of "reading knowledge," this skill 
can be defined with fair precision. At the same time, the gap 
between the skill as defined and the skill in use shmild not 
be lost sight of. 

This general state of affairs in regard to reading (however 
approximate the foregoing statement of it is) is naturally 

%. w«.t, ^'Th« Pr<i»bl«fli of ’Wtaninf*" in Reoding in a Foreign Lenguagef'’ 
Hodern Lmngumgt Journml XV (1931) 48I*9« 
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the background from which one turns to consider the oral-aural 
skills. Much debated at the present time is the degree to 
which such transfer is possible > One frequently hears that 
the "spoken language" is not the "written language" and the 
degree ‘of difference willj of coursei be an important point 
in determining the amount of transfer which is possible.® 
Looking at the written and the spoken languages of Western 
Europej one can easily see certain obvious points of dif- 
ference. The spoken style is more loose than the written; 
sentences are shorter, and simpler. Some differences also ap- 
pear in morphology; for example, the past definite tense of 
French and the secondary subjunctive of German are certainly 
less frequent in the spoken language than in the written. 

The issue is sharpest, however, in regard to vocabulary. 
At certain points the frequency counts obviously reflect 
written materials rather than spoken ones. For example^ the 
prevalence of knights, princes, and wolves may be largely due 
to the fables and fairy tales which frequently figure in the 
material used for the word-counts; and souls are perhaps more 
frequently written about than talked about. 

As our investigation was being organized, the suggestion 
was frequently offered that actual counts, similar to the 
vocabulary and syntax counts existing for written materials, 
be undertaken of speech. ® For various reasons which are not 
relevant here, these studies were never carried out; yet 
enough initial planning was done to reveal very clearly the 
problem of sampling involved. 

H. W**t, ”The Present Position in Voeebnlery Selection," Modtrn 
Lmngmgt Journal XXI (1937) 433-7; F. C. Heyes, "Wbet is e Besie Word?" 
Hitpmnim XXII (1939) 307-10. 

^®Some word-lists for ornl use, chosen priossrily by e subjectire elter- 
stion of the frequency lists for written aeteriels, here been suggested in 
the past, but obriously they here had little influence on the texts and 
Materials now being used in aural-oral instruction. Anoag the lists are: 
0. P. Schinner and H. G. Wendt, "A Suggested List of 1,000 Aetire Geraan 
Words," Corn. Quart. VI (1933) 77-901; J. B. Tharp et uL, A Baaie French 
Yoembulury (Wasningt^E: ModarE LaEfuaga Joaraa 1, 1934). 
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In making such counts , clear distir^ction would have to be 
made between three different types of conversation which could 
be recorded. If we take Biglish as the language of illustra- 
tion, then we could record English conversations (a) between 
foreign visitors and native English- speakers in the United 
States or the British Empire, (b) between foreigners and 
and native English-speakers in the foreigners’ country, or 
(e) between native speakers of English. 

The traveler sf<ems primarily concerned with the problems 
of travel, shopping, and daily living. If we define "oral 
English" as that which the foreign visitor first needs when 
traveling in an English rspeaking country, we will find it to 
be the language of the hotel, restaurant, and store. As a 
result, the phrase books and oral courses intended primarily 
for the traveler have always stressed "situations" or "topics" 
of this sort. Since the Army was training potential travelers 
in expeditionary forces, the ASTP materials also emphasised 
this area of oral conmunication, and this tourist talk is 
what many people have in mind when they refer to the "spoken 
language."^ 

In the second possible type of conversation, the foreigner 
would be speaking English to American or British visitors in 
his native country. In this case he would need the English in 
which to carry on his business or profession or in which to 
converse with them socially. He is not buying tickets or 
ordering meals. If he performs these services for his guests, 
he does it in his native language, not in English. 

The third type of English conversation which could be 
recorded would be that between native speakers of English. 



eli« touri.fc, howtT«r, will find thin nueh lancuagw adwquatw only 
inyitrS •uporfieinl eontnet with natiy* aponkorw. If hw ia 
in itad into thair hoaaa or otharwiaa aneountara thaoa aocially, tha talk ia 

*ik % "T*. topica. Tha trayalar'a ability oaaraly "to gat aroand" 
will halp hin hut littla in thaaa aoeial eonyaraationa; hut thay ara "apokan" 
too— aa ara noyiaa. radio prograMa. aaraona. and laeturaa. 
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If we listeE to talk in a restaurant, we will find that the 
speakers order a meal, ask for the bill, and pay it. But 
between these little dialogues of arrival and departure, many 
minutes or hours intervene in which their conversation does 
not concern finding the railroad station or sending out the 
laundry. They are telling jokes, passing on the latest gossip, 
or doing any number of linguistic things other than using the 
phrases of the tourist. Readers can check this point by re- 
calling their own speech for the past few days. Many of us 
have traveled, ordered meals, and asked directions. But even 
aOj these activities have affected only a very minute part of our 
total flow of speech over a period of iorty-eight or seventy- 
two hours. The bulk of our talk has been with family, friends, 
and fellow workers and has concerned an enormous variety of 
subjects. 

If, therefore, we attem^Jt to record "the spoken language," 
obviously the type of conversation we sample will directly 
control the kind of language we find. If we record speech at 
a ticket window, we will get a certain amount of the material 
usually embodied in lessons entitled "At the Railroad Station." 
But we will need to turn off our recording apparatus promptly. 
Otherwise the situational phrases will be buried in the flood 
of other conversation once the tickets are bought: discussions 
of the baseball season with the ticket seller, qpiieries whether 
members of the family remembered to turn off the gas heater, 
and countless other topics discussed in the neighborhood of 
ticket windows. 

Of course, whichever one of these situations is covered, 
there will be an almost complete overlap in the commonest 
function words: articles, prepositions, pronouns, and the 
like. But the content words (the nouns, verbs, adjectives, 
and adverbs) will vary considerably. Until extensive counts 
of oral materials have been made, predictions concerning 
them must be purely speculative. Yet the study made by the 
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Bell Telephone Company* and similar smaller counts for oral 
English suggest the likely outcome. To take but one examplei 
some of the commonest English nouns, as determined by the 
telephone study {order, price, car, letter, company, office, 
shipment), clearly owe their rank to the fact that 80% of the 
conversations recorded were business calls. This result is 
not surprising since our existing literary counts tend to show 
the effects of sannpling; a larger proportion of personal let- 
ters or newspaper articles, for instance, would have made 
considerable difference in the lower frequencies of the pres- 
ent counts of what are loosely called "written material*" 
If, in the collection of oral materials, sufficiently 
large samples were taken in order to rule out possible bias, 
an oral frequency list might emerge which would not differ 
very markedly in vocabulary and idiom from the ranks obtained 
for the written materials, provided the sampling for them too 
was increased to avoid what may be their present bias. Thus, 
in vocabulary and idiom, the "written" and "spoken" languages 
might not be so diverse as is sometimes claimed. As we have 
said, this hypothesis is pure speculation until adequate data 
for a Judgment are available. We have advanced it here only 
to indicate how dubious are some of the assumptions frequently 
made about the differences between "the written" and "the 
spoken" languages. 

Meanwhile, without exact frequency counts based on speech, 
a state of affairs has arisen in regard to the oral-aural 
skills which merits the closest attention. Most of the cur- 
rent oral-aural courses emphasize the situations in vdiich the 
traveler finds himself; and their texts and other materials 
stress the vocabulary and idiom appropriate there. In part, 
they may do so because of a common tendency to confuse the 

«N. «. Fr«nch, C. W. C.rUr, Jf . , and W. KoaBig, Jr., The fords mnd Sounde 
a^ioi *fo ConversmtioH, New York; Bell Telephone Coapany Monographa, 
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"situational vocabulary" with the whole of the spoken lan- 
guage. (Yet many conversation? about politics, daily life, 
or personalities are not too different in vocabulary from 
newspaper or magazine articles on these topics.) Pedagogical 
convenience may also favor the choice of situational ma- 
terials. At the early stages of language learning particu- 
larly, classroom conversation (at best an artificial and 
highly perishable product.) can best be nourished by "playing 
store" and using similar situations which lend themselves to 
dramatization. In the third place, teachers may feel that this 
language of "getting around" is really the phase of oral- 
aural skill most likely to be useful to students. 

Ubanimity does not exist even among those courses stressing 
the environmental vocabulary because they do not handle the 
same situations or handle them in the same fashion. Thus one 
Spanish class follows sport by going to the bullfight; an- 
other, by attending a soccer match. One class learns to order 
international items like beefsteak and French- fried potatoes 
at the restaurant, while another explores native dishes. These 
differences may appear petty but they make a very real dif- 
ference in the kind of vocabulary the student controls at the 
end of two years. This is no nciw situation. About fifteen 
years ago, Tharp and his colleagues^ found in their examina- 
tion of seven conversational manuals that only 7% of the 
vocabulary items (161 words) occurred in all seven. 

That the same diversity marks recent materials can be 
easily demonstrated. Three Spanish texts, intended primarily 
for oral-aural work, appeared in 1944 and were used by many 
experimental and conventional classes: Krakeur and Brugada’s 
Las Aventuras de Roberto Martin, LaGrone's Conversational 
Spanish, and Trevino’s Spoken Spanish. In relation to the 

9j, B. Tlliarp et al., op eit. 

G. Krakeur and 1 . BrUgadai Lot Aventurat de Roberto tfart in. New York: 
Deeca Racorda, Inc., 1944. u. G. LaGrone, Conversational Spanish for Begin- 
ners. New York: M. Holt and Co., 1944. S. N. TrevilTo, Spoken Spanish. 
Boston: D. C. Heath and Co., 1944. 
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Keniston their vocabularies are distributed as fol 

lows: 



DISTRIBUTION OF 
FOR SPANISH 


VOCABULARY 

AURAL-ORAL 


OF THREE 
CLASSES 


TEXTS 


Keniston Classification 


TreviHo LaGrone 

No. of Words No. of Words 


Krakeur 
No. of Words 


Group 1 


499 (34%) 


325 (50%) 


290 (25%) 


Group 2 


245 (16%) 


77 (12%) 


146 (13%) 


Group 3 


177 (12%) 


55 ( 9%) 


133 (12%) 


Group 4 


179 (12%) 


46 ( 7%) 


135 (12%) 


Total of IKeniston’a 
basic list of 2,000 


1100 (74%) 


503 (78%) 


704 (62%) 


Derivatives of Groups 
1, 2, 3, and 4 


100 ( 7%) 


55 ( 9%) 


122 (10%) 


Total in Keniston' s list ; 
of 3,060 words 


1200 (81%) 


558 (87%) 


826 (72%) 


Words not in Keniston’ s 
total list (3,060) 


281 (19%) 


87 (13%) 


318 (28%) 


Total Vocabulary of Text 


1481 (100%) 


645 (100%) 


1144(100%) 



llH. Keniston, A Standard Litt of Spanith Vord$ and Idioms. Boston; 

D. C. Hssth *^®** J,^JJ* . are subject to slight insccurscies for 

All such counts sno conpsnsons are auBjecn. a , diiff-rent 

not effected by these asttsrs, especislly in regsrd to Spsnish. 
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Since about 20% of the words in each of the three texts 
are drawn from the vocabulary beyond the 3,060 words of the 
Keniston list, it might seem as if the words chosen by the 
three authors would clearly suggest the additional (or dif- 
ferent) vocabulary needed for aural-oral work. Such is hardly 
the case. If we consider the "non-Keniston" words as a group, 
we -find that only eleven of them appear in all three texts: 
autobus, avion, cerveza, deports, equipo, frito, gasolina, 
gerente, patinar, resfriado, and tomate. "Skating" is hardly 
'a distinguishing characteristic of the spoken language, and 
the ubiquity of "tomatoes" seems equally fortuitous. The 
presence of "bus, " "plane," and "gasoline" probably reflects 
only developments in transportation which would also affect 
modern written materials. So the list of things more talked 
about than written about (such as "colds," "managers," 
"sports," "teams, " etc.) which are suggested by this unanimous 
selection is not long. 

Though the small vocabulary of LaGrone’s text may seem to 
give a spuriously small figure for the degree of overlap in 
the "non-Keniston" words of the three vocabularies, the re- 
sults can be substantiated by further comparisons between any 
two texts. For example, LaGrone uses approximately 87 of these 
words, but only 19, or 22% of them, also appear among the 281 
words of this type used by Trevino — only 8 more of these 
words than the 11 which appear in all three texts. Similarly, 
both Trevino and Krakeur use a fairly large number of these 
words, 281 and 318 respectively; but only 46 of them (16% of 
those used by Trevino and 13% of those used by Krakeur) are 
common to both. 

Similar studies of the texts for other languages reveal 
the same situation. The texts developed for aural-oral work 
do not follow the frequency lists, yet they do not agree on 
the vocabulary content of the elementary "spoken" language. 
The cause of this disagreement is clear. Most "situations" 
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actually demand a full command of vocabulary. The housewife 
"at the market" must know the scores of words denoting comumon 
fruits and vegetables; but the author of a single elementary 
text can select only a dozen such words. It is hardly sur- 
prising that these choices are not unanimous. 

Meanwhile classes working primarily with reading materials 
and having their aural-oral drills based primarily upon them 
will be familiar with a vocabulary much closer to that of the 
written counts. The possibility of covering both types of 
vocabulary (the environmental and the freqiMncy) exists, and 
most programs which use a prolonged oral=aural introduction 
but retain reading ability as their primary aim, rest on the 
hypothesis that this combination can be achieved. Yet if the 
"written" and the "spoken" vocabularies are as distinct as 
is usually assumed, the learning burden of elementary vocabu- 
lary is doubled, and courses covering both areas wijl do less 
with either than courses which give primary emphasis to one . 

One possible solution to some of these difficulties is the 
"minimum adequate vocabulary" or "vocabulary of maximum cov- 
erage," a device used by many workers in the field of English. 
Possibly the most familiar of these is Basic English, which 
by general terms, circumlocutions, and definitions claims to 
be able to express all concepts through a very limited number 
of words. Little work has been done along similar lines in 
foreign languages. These small-but-mighty vocabularies have 
obvious advantages in controlling reading materials and in 
enabling the student to express himself in speech and writing 
since for these latter skills he can stay within the limits 
of the system which he knows. But their lack of popularity in 
the foreign- language field may be due to the same objection 
urged against them in English: their shortcomings in regard 
to aural comprehension (for the student can understand only 
a speaker who knows and keeps within the system the student 
knows), and their supposed clumsiness and lack of colloquial 
tone in oral expression. 
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The issues can be exemnpiified by taking the definition of 
one worker in the field, who is particularly interested in^ 
the oral-aural approach: 

A parson hss "learned” a foreign language when he has thus first, 
WXthin a. liiwited vocabularvi, mastered the sound system (that is, 
when he can understand the stream of speech and achieve an 
understandable production of it) and has, second, made the struc- 
tural devices ( t ha t is, the basic arrangement of ut te ranees) 
matters of automatic habit. This degree of mastery of a foreign 
language can be achieved by most adults, by means of a scientific 
approach with satisfactorily selected and organised materials, 
within approximately three months. In that brief time the learning 
adult will not become a fluent speaker for all occasions but he can 
have laid a good foundation upon which to build, end the extension 
of his control of content vocabulary will then come rapidly and with 
increasing ease. [lUhdleriining in the original.] 

The scope and content of this linnited vocabulary will deter- 
mine the kind of "mastery" thus intended, for the specific 
selection made will influence not only the content words, but 
will also dictate (to some degree) the structural patterns 
the student practices. Most important, the student who has 
"learned" a language as thus defined, can certainly not talk 
about everything or understand what is said to him — except 
within the particular vocabulary chosen. "Understanding the 
s.tream of speech" also raises questions regarding the speed, 
clarity, and amount of the speech heard. 

In short,, as regards the definitions of the oral°aural 
skills, we have ye.t to arrive at as clear a definition as in 
the case of reading (despite the obvious shortcomings and dif- 
ficulties of that definition). The vocabularies and construc- 
tions chosen do not have a common reference point as those of 
reading have in the frequency counts. And those which have 
been selected by individual teachers or staffs have been 
based on differing principles. 

12c. F^ies, Teaching and Learning Eng lie h ae a Foreign Language . Ann 
Arbor: Uniteraity of Michigan Preaa, 1945, p. 3. 
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TTlie problem of judging the adequacy of such a common stand- 
ard or definitirai, however, assuming that it could be arrived 
at, presents one special difficulty in the oral-aural area. 
As we have seen, the "reading knowledge" is expected to be 
open to considerable supplement; the student will be able to 
look up words, forms and constructions unfamiliar to him. In 
speaking and listening, such pauses for reference are usually 
not possible. Though some conversations have been carried on 
with much thumbing of the dictionary, usually t;he -‘jpeaker will 
nvot wait while the hearer looks up words; the latter must get 
the language on the fly. Much the same is true of speaking. 
Hie speaker of a foreign lang^iage cannot take hours to utter 
a sentence, especially in view of the fact that he is usually 
better understood if he manages to rush his words together 
in the way the native is used to hearing them. The listening 
and speaking standards, therefore, must be higher than that 
taken for "reading knowledge" because they cannot be supple- 
mented at need on the spot. 

Thus in the oral-aural skills there is often a wider gap, 
for example, between "aural comprehension" and being able to 
understand any normal speech of a native speaker than there is 
between "a reading knowledge" and being a]|;^}.e to read any given 
material in the language. This problem vexes all discussion 
of the newer courses and frequently gives rise to complete 
misunderstanding. Such confusion would certainly result if 
an outsider expected that after three months the student who, 
had "learned English" according to the definition just quoted 
would be able to say anything he needed to say or be able to 
understand almost anything said to him. 

To sum up, as the reader examines the "experimental" and 
"conventional" courses reported in the following pages, he 
will find that the fomer give much greater emphasis to inten- 
sive instruction in the aural-oral skills. But these courses will 
differ considerably in their specific practices in regard to 
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the content of the "spoken" language i the degree to which 
'these skills are to be attained in two college years, and the 
purposes which these abilities are thought to serve. Needless 
to say, unless the next few years bring greater clarity on 
all these points, the present confusion and contradiction 
will continue. 



Chapter III 



The Measurement of Language Profieieuey 



Within the competitive system which characterizes American 
culture, it is not unnatural for teachers, along with other 
producers of goods and services, to proclaim the excellence 
of their product. Lately, teachers of modern foreign lan- 
guages, experimenting widely with new methods and techniques, 
have not hesitated to claim superior results. These claims 
have tended, however, to be based on teachers’ subjective 
judgments or, if supported by concrete data, on evidence 
drawn from tests devised by the teachers themselves in con- 
nection with the particular materials used in their own 
courses. If the Investigation was to appraise objectively 
the attainments of students in a wide range of experimental 
and conventional courses, it needed more than personal claims 
and estimates. We ourselves were able to attend the classes 
of several experimental programs; but, however impartial we 
might hope to be, our personal standards would be little more 
valid and reliable than those of individual teachers. In order 
to judge the success of instruction, we needed as accurate, 
impartial, and comprehensive a testing program as could 
be devised. 

The majority of the newer courses which we sought to 
evaluate set as their initial objective the ability to handle 
the spoken form of the language — > that is, the development 
of the aural and oral skills. In few, if any, of these 
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programs, however, were the aural-oral skills regarded as 
the fihal or only goal. The ability to read widely in the 
language was usually retained as the most desirable ultimate 
objective. Thus in both experimental and conventional courses 
the measurement of the reading skills was a conmon ground for 
testing. 



READING TESTS 

As the result of development over the past decade and 
more, there exists a fairly well established level of achieve - 
menit as regiu'da the difficulty of content and the range of 
vocabulary <md graimnatical construction to be mastered for 
reading purposes. For the comnonly taught languages, numerous 
textbooks have been prepared in ac:;Cord with the word-counts, 
idiom-lists, and syntax-lists, which form the basis for this 
standard, and objective tests have been developed along these 
same lines. Among these are the Co-operative Tests published 
by the American Council on Education, which have been in 
nati(»i-wide use for a dumber of years, with norms established 
for each of their parts: reading comprehension, recognition 
Vocabulary, and functional grammar. To measure these skills 
on the basis of the one-year and two-year norms for these 
tests seemed to us a satisfactory method of appraisal which 
would eliminate the need for devising and standardizing 
similar tests of our own. 

The number of college students who pursue the study of 
languages decreases sharply at the end of one, and especially 
two, years because the majority of colleges require only these 
amounts for graduation. Since, consequently, the end of the 
first and the second years were the points at which the most 
testing data would be available, we decided to administer 
the advanced level ^ of the Co-operative Tests at both these 

lR*Tia«d; S*ri«a, 1937. In Franeh, Adyanctdl Forna N, 0, P, Q, or R; in 
Garaan and Spaniah, Advanead Foraa N, 0, P, or Q. 
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points. Scores are relatively low on the advanced forms at 
the end of the first year; but since satisfactory are 
available at that stage, we preferred the advantage oi com- 
oarable scores for both years, as conpared with the alter- 
native of using the easier elementary forms the first year 
and shifting to the advanced forms at the end of the second. 

Since our studies were also to cover Russian, we developed 
a Russian test on the model of the Co-operative series, which 
at that time did not include that language. No frequency count 
of written Russian existed when this test was constructed; 
the author,^ an experienced teacher of college Russian, had 
to rely on her own judgment in setting a level of difficulty 
which would be, part by part and item by item, generally 
comparable to that of the Advanced Co-operative Tests in the 
other languages. Hie Russian test was administered to students 
in seven colleges, and tentative norms based on this sample 
are included in Appendix A along with the norms for the 
Investigation’s aural tests. 

TESTS OF AURAL COMPREHENSION 

Up to the present time, standardized measures have been 
in general use only for testing the reading skills. Even some 
of the early experimental courses with aural-oral emphasis 
were compared with more traditional programs solely on the 
basis of the students’ ability to handle the written language. 
Ihis limited testing was inadequate to our purposes. Students 
who have been taught to control the spoken language, even 
though they may ultimately demonstrate as high a reading pro- 
ficiency as students trained primarily for reading, are 
assumed to possess additional skills which the other students 
lack and which it would be desirable to a](praise, especially 



^Francea Marahak-Sobotka, 
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if it is claimed that learning to speak and understand the 
language is the chief source of those students* motivation. 
Furthermore, we did not feel justified in assuming so high 
a degree of correlaticm in individual students between reading 
and autial-oral skills that a high score on a reading test 
would necessarily indicate equal ability to speak and under- 
stand, or vice versa. As a result, we felt the need for a 
series of tests which would measure directly and reliably the 
aural and oral abilities. 

In the aural field, the pioneering efforts were the 
Lundeberg-Tharp Audition Tests for French, German, and 
Spanish. Designed to measure aural skill on an elementary 
level, these tests had been administered widely enough 
throughout the country to have an established set of norms 
for the end tof the first and of the second year. ^ Despite 
the existence of these norms, #e questioned their objectivity 
because of the varying ways in which the tests had necessarily 
been administered. The material to be comprehended is spoken 
by the teacher giving the tes^, and thus there is little 
assurance that students in different schools hear the material 
delivered with comparable accents (native or non-native), at 
comparable speeds, and with comparable facial and other 
gestures. 

During the war the testing staff of the US Armed Forces 
Institute had begun a set of aural tests modeled on the 
Lundeberg-Tharp series. This organization was disbanded, 
however, before the tests were completed although three 
preliminary forms had been prepared in several languages 
and had been tried out in various high schools and colleges. 
Though we made extensive changes in the form and content, we 



^For description* of these tests, 
Foreign Lmnguegez end their Temehing 
1937) S42ff. 



see R, D. Cole end J. B. Thorp, Modern 
(New York: t). Appleton Century Co., 
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managed to avoid some duplication of effort by being able to 
secure such preliminary tests and data as were available at 
the close of that project. But these tests toohad been admin- 
istered by local teachers, and there was some evidence that 
considerable variation in student achievement could be attrib- 
uted directly to the different ways in which the materials 
had been read. 

In contrast to recent reading tests, which are based on a 
well-defined series of criteria as regards vocabulary, idiom, 
and syntax, the aural tests which we have mentioned could be 
based on no similar canon of materials common to the aural- 
oral method because none had been established. Pioneers in 
the construction of aural tests had had no criteria other 
titan the counts based on samplings of the written language, 
lliese items, though likely to appear frequently in reading 
texts, are not necessarily encountered in any single book 
designed for the conversational or aural-oral a]|^roach. These 
textbooks themselves were comparatively few in number; and 
while each endeavored to embody the kind of words and patterns 
most commonly used in speech situations, their respective 
authors had quite differing notions as to what makes up the 
most important vocabulary of speech.^ We too had no choice 
but to adopt the criteria used by the earlier tests, the 
existing lists. 

The most important contribution we could make within the 
time permitted us was to standardize the spoken materials by 
recording them on phonograph discs, thus making certain that 
students everywhere would be hearing the same voice at the 
same speed, and with the same absence of nonlinguistic clues. 
This technique, though greatly improving standardization, 
certainly does not render it perfect. We sought to overcome 
some of the difficulties. The recordings themselves were the 

♦cf . pp. 32ff. above. 
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most faithful that could be produced, made in a well-known 
commercial studio under the direction of technical experts. 
Sets of instructions were issued to administrators of the 
tests, specifying what conditions should be met, such as the 
use of a high*>quality electric phonograph with a light tone° 
arm), a metallic shadowgraphed needle, a room with satisfactory 
acoustics, with the loudspeaker placed at ear level in front 
of the class. The fact remains, unfortunately, that these 
instructions were not always followed; and m Eny cssCf not^ 
all rooms and phonographs are ecjually good. Ihe conditions 
Under which the tests are actually given ranged from labora- 
tories carefully prepared by acoustical experts to the most 
casual of arrangements in which the records were played on 
ancient portable phonographs in run-of-the-mill classrooms. 
Airplanes, riveters, and sound-trucks sometimes added compli- 
cations. It is, of course, imnpossible to calculate the dif- 
ferences in results produced by these variable physical 
conditions, and we have had, to' trust that they did not con- 
stitute a major factor in the 'bulk of the scores. 

Form and Content 

Two tests were constructed in. each of four languages; 
French, German, Russian, and Spanish. They consist of an 
elementary, or '"lower level," and an advanced, or "upper 
level," test.^ Each test is composed of three parts, and may 
be administered to a group of any size in a maximum of fifty 
minutes. 

The lower-level te&;ts were designed for students who had 
accumulated a total of betv/een 90 and 130 class hours in 
college. Part One consists of twenty-five completion items, 
each with a three -choice response (worded in English); for 
examl!>le, the voice says: "•$« cultivim las floras en un....," 

i . 

^In Ftiinclli Md Spanishi both the lower end the upper level teste were 
nede in two foras (A end B) designed to be of equivelent difficulty. 
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and the student answers by choosing among the expressions 
garden, box-car, coal-mine , printed in the test-booklet. 
Part Two consists of twenty-five definition items, each with 
a three -choice response; for example, the voice says: ”Ein 
Mann, der Fleisch verkauft,” and the student chooses his 
answer from among baker, butcher, doctor. Part Three is 
made up of six short anecdotes, with from five to nine triple- 
choice responses, worded in English, on the content of each.® 

The upper- level tests were intended for students who had 
received more than 150 class hours of instruction. Part One 
consists of twenty- five definiticms; Part Two is composed of 
six anecdotes with from six to nine triple-choice responses 
on each; Part TThree consists of a five-minute dialogue between 
a man and a woman speaker, with fifteen triple-choice re- 
sponses on its content. 

Problems of Construction 

We found ourselves confronted, as we developed these tests, 
with a thorough lack of accepted standards as regards ( 1 ) how 
fast a flow of speech, (2) how long an utterance, (3) how wide 
a range of spoken words the student can be expected to under- 
stand at specified stages in his learning process. Earlier 
aural tests had failed to set such standards, and without them 
we had no accurate picture of the range of aural ability our 
tests would be expected to measure. Our work was to be pri- 
marily with intensive courses, providing anywhere from six to 
ten hours of conversational practice with native speakers, 
which were still in the blueprint stage. The ASTP experience 
h a d raised high the hopes of oral-aural enthusiasts among the 
language teachers, who foresaw their charges attaining 

®Th« ■ike-iip of tht French Lower-Level teet dliffere from^ that of the 
ohher languagee in that the Q>apletion Seriea ia replaced by thirty Phonetic 
Accuracy iteas, each with a four-choice reaponae; for exainpie, the voice 
aaya par lent and the atudent chooaea hia anawer anong the formia parlom, 
pmrlmmea, pmrlant, partmht, appearing in the teat booklet. 
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near-native expertnesa at the end of one, or at the most two, 
concentrated years. Thus, although we had no actual basis for 
knowing what the level of aural performance would be, we 
could hardly ignore the widely made assumption that in many 
specially taught groups it would be high. For these students 
our tests would need a high ceiling. At the same time our 
examinations would be taken by large numbers of students 
conventionally taught without emphasis on aural attainment. 
Suspecting that in any case the range of skill to be measured 
would be considerable and doubting that a single test could 
cover it adequately, we constructed the tests at two levels 
in each language. 

In establishing standards of speed and length of utterance, 
we endeavored to base our criteria on normal speech. We 
argued, in the first place, that speakers of a language (other 
than elementary teachers of it) rarely distort the rhythm of 
their speech by introducing superfluous. or unnatural pauses 
within normal word-groups. We therefore made sure that such 
choppy speech would not be .heard in our aural tests by direct- 
ing the (native) speaker to keep his natural habits of 
rhythm and juncture,' and to reduce only slightly his normal 
conversational speed. 

We further argued that often a person is called upon to 
apprehend speech sustained through considerably more than a 
single sentence for example, when listening to a lecture, 
radio broadcast, or sound-movie. For this reason we included 
the anecdotes, which are two or three minutes long, as well 
as (in the upper-level forms) a five-minute dialogue. 

In the selection of vocabulary, we were forced, as we have 
already noted, to rely on the existing word-counts^ since no 



^For Freiielli; Vandtr Beks, French Ford Book (New York: MacBillan, 1941). 
For Garaan: Morgan, Gcraan Frequency Word Book (New York: Maeaiilan, 1937) 
and Wadapnhl and Morgan, Minimum Stmndmrd Germmn Yocakulary (Naw York: 
F. S. Crofta, 1944). For Spanish: Buchanan, A Graded Spanie h Word Book 
(Toronto: UniTersity of Toronto Press, 1927) and Kaniston, A Standard Lie t 
of Spanieh Yorcft and Id tost (Boston: D. C. Heath, 1941). 
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other criteria were available. There is far too little overlap 
of vocabulary from one to another of the conversational text- 
books now in Use to provide a common body of words of any 
appreciable size. In the lower-level test we restricted the 
vocabulary to the 1500 most frequent words, though adding a 
few itfiims admittedly commoner in spoken than in written idiom, 
and a few cognates of English words. In the upper- level tests 
the limit set was the first 3000 words. However, the use of 
the high-frequency ranges of the word-counts resulted in"<a 
very small incidence of such vocabulary items as form the core 
of the "spoken language” textbooks. The vocabulary of these 
texts is largely of the type employed when a person is order- 
ing a meal, sitting in a barber’s chair, or trying to get his 
car fixed, and it consequently tends to omit many of the 
general words which have been found commonest in the written 
language. Thus, for example, of the total word -content of 
the Spanish Lower-Level test (Form A) only 36 per cent is 
found in the first half of Trevino’s Spoken Sponish; of the 
total word-content of the upper-level test (Form A), only 77 
per cent occurs in the entire book.® Despite this situation, 
i t was evident that if our aural tests were to be used generally 
— that is, by st.udents taught by many different procedures 
and materials it was wholly out of the question to intro'^ 
duce carburetors and cauliflowers into selections designed 
to 'test aural comprehension. 0ns4ch.a basis, no matter what 
the particular choice of specialized words, the tests would 
necessarily have proved unfair not only to students of high- 
frequency vocabulary, but also to users of most aural-oral 
textbooks other than the one happening to embody the particu- 
lar words occurring in the tests. 

• In addition tb' actual auditory apprehension of a spoken 
utterance and knowledge of the meaning attached to the sounds 

ifor ForM B, thi eorrasponilini aiiiouiits of ovcrllap are: Lower Level, 43 
per; cent; Upper Level, 60 pet cent. 
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composing it, adequate comprehension very often depends on 
the listener’s awareness of certain facts or assumptions 
bearing on the subject of discourse but not uttered in the 
actual speech situation. In the testing situation, however, 
it seemed to us . imperative to eliminate this variable. 
Consequently, in order to respond to the test items, the 
only knowledge required, beyond what is contained in the 
actual utterance, is that which is probably common to all 
adult members of American society. 

Ol^viously many types of response made to comprehension in 
real ^situations cannot be used in an objective test. Oral 
responses cannot be made to serve as a measure of comprehen- 
sion, since adequate answers may themselves be inhibited by 
numerous non-aural factors and since these answers, however 
appropriate, cannot be scored objectively. Consequently 
substitute responses must be utilized in the form of multiple 
choice. This substitute type of response, while eliminating 
the variables inherent in the svoken responses, must in turn 
be kept free of :Obstacles. One such obstacle would lie in 
the i|written form of the language being tested, especially 
since many programs planned to postpone or minimize work with 
noririal orthography. To avoid this hazard, all the answer- 
choices of the tests appear in English, thus assuring that 
failure to answer a comprehension item is not due to inability 
to interpret correctly the. choices themselves. The bilingual 
procedure involved here is seemingly not a hazard; most first 
and second year students, even while listening to a foreign 
language, are doubtless thinking in English and will not 
find their . mental processes wrenched by. the sight of English 
answer- choices. 

Every attdm.pt was >madd to reduce to., a minimum . .other dif- 
fici^lties. w|ich- the otudehts might experience. Thus they were 
fir.«) f allowed to hear a warm-up passage, which was not part 
of the test proper, in the hope that it would accustom them 
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to the strange recorded voice and help them relax their 
initial tensions. In the body of the tests, all part=numbers, 
item-numbers, references to exercise-grovips , and the like 
were given by the' speaker in English, so as to help. the 
student keep his bearings. 

Reliability 

■ 1 ' 

The reliability coefficient is an index of the degree to 
which the score of a student on a particular test may be 
taken as an accurate prediction of his scores on a series of 
equivalent tests.. Unless all these scores were similar, any 
one of them would ^ be an inaccurate measure of the ability 
covered by the tests, say, the ability to understand spoken 
French. This coefficient is usually found by calculating the 
correlation between the scores made by a group of students 
on two equivalent' forms of the test; or, when only one, 'form 
is available, it is divided into two parts on the basis of 
the odd versus the even items or by some other method of 
division which will produce equivalent, halves. A number of 
complications affect this procedure in any kind of. testing.. 
Four factors merit special notice here because they are con- 
nected with the problems of aural testing and because they 
tend to lower the coefficients reported in Appendix C. 

Aural testing produces a somewhat unusual situation. In 
taking most tests, the, student first works rapidly through , a 
section, answering those items about which he is certain and 
returning later for a, more careful consideration of those 
items about which he feels less sure.. In an aural ; test this 
procedure is impossible. The student cannot turn the teacher 
or the phonograph .record back to the particular items , he may 
want to reconsider. He must deal with each,. one at the, time it 
is spoken; and, though considerable time is given him in 

^Cf. L. J. Cronback, "A Caae Sttidy oi the Split-Half Reliability Coef- 
ficientp" Journal of Educational Pcychology (1936) 473-80. 
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which to record his answer, he must eventually choose some- 
thing or else leave the item unanswered. It is practically 
certain that his auditory memory will be unequal to the task 
of allowing him to go back at the end of a part or of the 
entire test in order to work on items he has omitted. This 
inexorable progress of the test may lead the student to 
guess. iThough judicious guessing improves the student’s score 
and often produces a truer estimate of his peripheral knowl- 
edge than does a too cautious approach, the aural situation 
calls forth wild rather than judicious guessing because the 
student feels he should take a flyer while he has a chance 
at the item. The customary formula used to correct objective 
test scores for guessing^® serves, on the average, to adjust 
'the total scores, but the part-scores obtained by the split- 
half techiiique are much less accurately adjusted. As a result, 
tests in which guessing figures will appear even more unre- 
liable than the guessing actually makes them. 

This, factor is closely connected with another which we 
have already mentioned several times: the vocabulary and 
other linguistic elements to which students have been exposed 
vary widely from course to course and text to text. As a 
result, this fact that many words and constructions in each 
test were unfamiliar to the members of any particular class 
probably further increased this tendency toward guessing. 

A third complication in constructing tests of maximum 
reliability was that the examinations had to be built prior 
to the experimental programs which they were to evaluate. 
Because many teachers were hopeful that new procedures would 
enable the aural-oral groups to far surpass students’ previous 
attainment in all the .skills, tfhe tests were made more dif- 
ficult than would have been desirable in view of the performance 

I®Tlie foraula is: Corrected acore = Right «nawera-=" wrong amawera ^ 

” choices offerea — 1 

that isi a teat in which three letiltiple-choicea are offered ia acored — 
righta itinna one^ half the numher of wronga. 
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of those conventionally trained students on whom they were 
tried out in the preliminary forms. Unfortunately, as we 
shall see in later chapters, the aural mastery of the experi- 
mental groups was frequently not markedly superior to that of 
the conventionally trained students. Hence, providing scope 
for the anticipated higher level of performance served only 
to make the tests too hard, and consequently somewhat less 
reliable, espficially for the conventionally trained students 
from whose scores the coefficients were computed. 

The fourth feature is that correlation coefficients are 
sensitive to extreme deviations. The figures we report, 
however, are based on groups of students rather homogeneous 
in ability and in amount of training. Had the coefficients 
been competed on more diverse groups, the figures would be 
higher — vpuriously so, however, though this procedure is 
sometimes followed. 

In sum, the reliabilities reported for the tests tend to 
be minimum estimates and are higher for particular classes 
in situations where some of the foregoing factors have been 
minimized. Certainly more reliable measurement is imperative. 
We would only point out, however, that in view of the chaotic 
state of theory and practice in regard to the aural and oral 
skills, the coefficients obtained are almost surprisingly 
large. Since scores were reported for the individual parts 
as well as for the total tests, we have given their relia- 
bilities also. In most instances, however, teachers used 
only the total scores, which are, of course, the most reliable. 

Evaluation of the Aural Tests 

Having discussed to this extent the problems of construct- 
ing aural tests, we hardly need to disclaim perfection. 
Av/are that the tests were necessarily of a tentative character, 
we solicited criticism from their users, and it was given 
without stint. Since the nature of the tests conditions the 
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results obtained from them, it is highly important to examine 
this criticism and to attempt to distinguish the sound 
elements of it from what we consider the more questionable 
objections. 

Some of the completion and definition items, it was oointed 
out, depend for correct response on the apprehension rf a 
single word. For example, on hearing the item ”Celui que Von 
paie pour qu'il se taise,” one cannot choose between lawyer, 
preacher, and blackmailer (the three answer- choices) unless 
one catches the final word, taise. In spite of our efforts 
to avoid them, a few such items appear in one or another of 
the tests. The item just cited is also characterized by a 
certain trickiness which is best avoided. 

The six anecdotes in each test were, for the most part, 
lifted from rather antique published collections, and many of 
them qualify as "old chestnuts." They tend to deal with the 
amusing quirks of imperious monarchs or eccentric men of 
letters, or to illustrate the wittiness of eighteenth-century 
courtiers. This is subject matter of a kind that the student 
has little familiarity with or interest in. If he happens to 
have read the anecdote in his language text, he has an 
obviously unfair advantage over his fellows. If not, he is 
baffled by the bookish flavor of the- prose, which in some 
instances is strictly eighteenth- ceiAtury, full of literary 
turns of phrase (especially the German) or of unfamiliar 
verb forms (e.g. , the French preterite). In the Spanish 
l^pper-Level test, some of the anecdotes appeared in Selecciones 
del Reader's Digest and were thus familiar to many students. 
Some of those in the Russian lower- level test have their 
source in a standard granmar used by many, though by no means 
all, learners of Russian. And while all these anecdotes were 
edited so as not to exceed the stipulated ranges of vocabulary- 
frequency, they still contained many words (e.g., French 
coquin) rarely heard in modern speech. Another factor is the 
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es8<?intiai structure of an anecdote | the whole significance of 
which is usually contained in its last sentence. This leads 
to considerable difficulty in phrasing multiple-choice 
statements on its content in such a way as to avoid giving 
away the main point without unfairly disguising it. Students 
who, in the actual listening, have wholly missed the "punch" 
of an anecdote will often be fairly successful in guessing 
the correct answers from clues in the wording of the multiple - 
choice statements. These various considerations have led us 
to favor instead a more realistic "slice of speech, " consist- 
ing of dialogue or expository prose. 

The five-minute dialogue constituting Part III of the 
upper-level tests represents one such type of selection on a 
larger scale. Thiese dialogues have been _ criticized as entail- 
ing, for correct response, too much mere memory of detail to 
constitute a valid test of aural comprehension. However, the 
passages were carefully selected as having logical cohesive- 
ness and unity; the answer-statements concentrate on the 
outline but not on the minute details of the conversation, 
and inquire about the characters and attitudes of the speakers 
in the situation; thus if the student has truly understood 
the dialogue., it is not a feat of memory to work out the 
answers. Ihey are in his consciousness as an inevitable conse- 
quence of real comprehensiotn. 

A defect of a different order is to be found in the passage 
at the beginning of the first record in each test. In this 
passage the speaker announces that in order to allow the 
listeners to familiarize themselves with .his voice and manner 
of speaking before the test begins, he will read the direc- 
tions for Part I in the foreign language. This "warm-up" 
passage invariably had an effect exactly opposite to that 
desired. Instead of relaxing and accustoming themselves to 
t«he speaker’s voice, the students were more unnerved than 
before because they understood nothing of what was being said. 
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This was of course merely because the vocabulary of directions 
was unfamiliar; but the psychological effect was bad as the 
students approached the first test item with the fearful 
conviciion that they would continue to comprehend nothing. 
There is evidence that many did not overcome their nervousness 
until the first part of the test was over and tension was 
released between that and the second part. It seems clear 
now that the warm-up passage should have consisted rather of 
a series of easy sample items of the same type as those making 
up the body of the test. 

Criticism which seemed to us less justified was aimed 
at the level of difficulty at which the tests were set. 
A frequent complaint was that the speech on the records was 
troo fast for the students to under stand. Besjptte this protest, 
the speech is of normal conversational rapidity in the Upper- 
level test, and somewhat slower in the lower-level. Many 
teachers argued that it was not justifiable to insist on a 
normal speaking rate when, as in the case of records, the 

ordinary visual aids to comprehension the speaker's facial 

[■ 

expressions, his gestures, much of his personality ~ have 
been artificially removed. To this we may answer, first, 
that radio speakers seldom feel obliged to reduce the speed 
of their delivery because titey are unseen by their audience; 
and, second, that a person listening to a high-fidelty 
recording or broadcast in his native lan^nguage rarely complains 
of difficulty in understanding the unseen speaker. What the 
protesting teacher is really contending^ then, is that his 
Students can understand the language only under limited 
conditions. When he tells us, for example.' "I suppose that 
the phonograph records are largely designed to take the place 
of nativs speakers; they would, therefore, scarcely be 
nscessary in our case," he is at least partially motivated 
by the thought that, native speaker though he is, his charges 
would perform far more creditably under hiS familiar and 
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studied (perhaps in this case even over-studied) delivery 
than when confronted with the unfamiliar and unembellished 
speech on the records. There is little doubt that they would, 
but this seems immaterial. Our object was not to test the 
adeptness of a given class at understanding their own teacher 
displaying his familiar tricks; it was rather to measure with 
a common yardstick the aural ability of language students 
from Maine to California. Such a common yardstick required 
a single voice speaking at a standardized speed. Through its 
use, we could at least determine objectively the extent to 
which, under the conditionf^ it imposed, students of a given 
language understood that language in its spoken form. If 
"aural comprehension" means only "the ability to understand 
a familiar voice, speaking Very slowly and overenunciating," 
this limitation demands more recognition than it has received. 

In summary, most language teachers have tended to think of 
the aural tests more or less directly in relation to their 
own particular course, textual materials, and students. These 
courses and materials, if not the students, are so diversified 
that the tests were bound to impress the individual teacher as 
unfair to his students. But he must be reminded that if his 
own full battery of suggestions for revising the tests were 
to be adopted, his colleagues directing other courses would 
then find them even less satisfactory than before. Given this 
existing diversity, we could ourselves only hope to devise 
tests equally unfair, if not equally fair, to ^*11 potential 
users. 



TESTS OF ORAL PRODUCTION 

In the field of speaking ability, we were faced with even 
fewer established standards of achievement than existed for 
aural comprehension. There was no consensus among teachers 
regarding the range of vocabulary or the degree of grammatical 
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complexity which the language student could be expected to 
use actively at the end of the first and the second yearJ 
As for actual tests of oral production, we knew of none in 
published form for general use. A group of testing experts 
at Queens College had been conmissianed to construct a seiies 
of oral tests for use in the Army Language Program, and while 
these tests were never fully developed, it seemed diesirable 
to draw upon the experience of the Queens experts and to have 
them prepare the oral tests. 

The tests were designed to measure speaking ability at the 
same two levels as the aural comprehension series: (1) the 
lower level, intended for students who had had less than 130 
hours of classroom ins true tiitui; (2) the upper level, designed 
for those who had accumulated more than 150 class hours. 

As in the case of the aural comprehension tests, and for 
the same reasons, there was no fair basis for vocabulary 
selection other than the standard word-lists. Working from 
these. We used the same criteria as for aural comprehension, 
i.e., up to 1500 words on the lower level and up to 3000 on 
the upper level. Difficulties of syntax were not intended to 
exceed those of vocabulary at the respective levels. 

Each test was designed in three parts, intended to measure 
three essential aspects of oral skill: ( 1 ) the ability to 
report a single, simple act or situation in precise words, 

(2) the ability to express a sequence of ideas fluently, 

(3) the ability to converse. As will be noted in the rating- 
scales reported below, the major criterion in all three 
aspects was intelligibility. 

Part I, the Picture Series, cemsists of twenty separate 
pictures, each representing a single simple action w^ich can 
be reported in a single simple sentence. Two sample pictures, 
shown at the beginning, provide below them printed answers 
which would be normal if expected in English, e.g.: "The man 

llThi* group eoaposed of H. N. Rivlin, I. A. Schwarts, H. Schuelar, 
and B. B. Friadman. 
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is waiting for v^lie train, " or "TTKe mouse is eating the cheese." 
The student makes his response to one picture before going 
to the next. His answer is rated by the examiner, as objec- 
tively as possible, according to the following scale: 

2 - Conveys • simple description completely snd correctly. 

Conveys the simple description completely snd correctly, 
hut elahorstes and in so doing makes some error or errors 
of vocabulary, grammar, or pronunciation errors which 
interfere little wi .h the under standabi lity of the 
utterance. 

i •> Conveys the simple description with one or more errors of 
vocabulary, grammar or pronunciation, these errors being 
such as not to interfere with the unde rstandabi lity of the 
simple description. 

0 - Conveys very little meaning. 

Conveys the wrong meaning. 

Makes errors which obscure the meaning. 

Says nothing. 

Part II, designated as Sustained Speech, calls for the 
student to discourse without interruption for two to three 
minutes on a topic assigned to him on the spot, such as the 
following: 

Lower Level: 

You are talking with, a Spanish- speaking person who has never 
been to the United States. Describe to him the town or city in 
which you live. (If further stimulus is necessary before time is 
up: ) This person is also interested in what a North American home 
looks like. Describe to him the home in which you (or your 
parents) live. 

Upper Level: 

You have met a young German in Europe who seems to you to have 
the makings of an outstanding American citizen. You resolve to 
try to convince him that he should emigrate to the United States. 
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Tallk to him about the United States ao thttt you may hel[k him 
decide whether he would like to come. (If further atimulua is 
necessary:) Your young German friend is interested in American 
schools. Describe to him life at the school you attend. 

In this part- of the test maximuin precision of rating seemedl 
attainable through attention to four separate qualities of 
response; consequently the following rating scale was devised: 

Fluency 

2 - Speaks smoothlyi phrasing naturally according to his thoughts. 

1 - Occasionally hesitates in order to search for the right word 

or to correct an erroi. 

0 - Speaks so haltingly that it is difficult to understand the 

thought he is conveying. 

Vocabulary 

2 - Vocabulary adequate for expressing the ideas he wishes to 

convey. 

■i| ’ ^ , ,, 

1 • Manages to convey his ideas in part, but in several instances 

uses an incorrect word or fails to find any word to use. 

P - Cannot communicate his thought because he does not have an 
adequate vocabulary. 

Pronunciation and Enunciation 

2 - Sufficiently approaches native speech to be cpnq>letely under- 

ttandable. 

1 • Can be understood, though with difficulty, because there are 

sounds which he does not utter correctly. 

0 m Would not be understood by native^ because his pronunciation 

is so different from theirs. 

Gramnfatical Correctness 

2 - Speaks correctly with no serious errors in correct grananat- 

ical usage. 

1 • Speech is understandable, but there are serious grammatical 

errors. 

Q m Speech is not readily understandable because it^ is so fulT,of 
granvaaticel -errors'. 
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Part III, the Conversation, consists of a directed exchange 
of remarks between the student and a native speaker whose 
voice is recorded on a phonograph disc. The student is asked 
to imagine that he is in the company of a friend whose native 
language is French, German or Spanish as the case may be. The 
friend speaks to him, and imnediately afterward another voice 
on the record directs the student in English what to reply 
to his friend. For example, the friend may say: "iCdmo esta 
usted?", whereupon .the English voice says: "Tell him you’re 
fine and ask him how he is. " Pauses are provided in the record 
while the student makes his contributions, which are rated by 
the examiner according to the following scale: 



2 • Expresses idea accurately. 

1 - Partially incorrect. 

Conveys the correct idea hut has one or more errors of gramnar. 
Conveys almost the correct idea, having one or two errors of 
vocabulary. 

0 - Only small part of idea conveyed. 

Wrong idea conveyed. 

Not understandable. 

No utterance made. 



At the end of each pause, a buzzer warns the student to 
stop speaking and prepare for the next interchange. 

Just as adding the uncontrollable factors inherent in an 
oral response seemed undesirable in the testing of aural 
comprehension, so in testing oral production we did not wish 
to assume that a stimulus spoken in the foreign language 
would necessarily be correctly understood. Hence, in the 
Picture Series the stimulus is purely visual. In the Sustained 
Speech it is merely the preliminary directions in English. 
In the Conversation the actual stimulus is the English voice 
telling the student what to say; the remarks of the foreign 
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friend serve only to provide the illusion of a real conver- 
sation, but they. do not have to be accurately understood 
before a correct response can be made. 

** f"m ‘ V 

TESTS OF WHITING ' 

/ 

Though it was theoretically desirable that' our testing 
program should be ccinprehensive, we did not include measures 
of writing for two reasons. One was that none of the courses 
collaborating most actively with us stressed this skill to 
any great degree. Even had this not been the case, the second 
reason would have been decisive,- lack of testing time. To 
test reading, aural comprehension, and oral production 
required large blocks of class time> which was already far 
too scarce. Even the testing of oral ability, a much more | 
important objective for all these programs, seemed likely to Ij 
suffer from this lack, and, events proved this fear to have -I 
been justified. To have attempted to measure writing skill 
also would merely have produced relatively unimportant data 
at the further expense of much more vital information. 
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Chapter IV 

The Aural and Oral Testing Program 



A primary purpose of the Investigation was the appraisal of 
basic language courses of the currently prevalent "experi- 
mental" type. With few exceptions, these experimental programs 
had a common basis in both method and objective. The method 
was said to be "intensive," comprising six or more contact 
hours a week divided between demonstrations by the course 
director and drill sessions with a native -speaking guide, and 
using textual materials especially adapted to this kind of 
study. The aim was first to give the student skill in speaking 
and understanding the language and then to build a reading 
knowledge on the foundation of his oral and aural skills. We 
use the term "experimental" to denote a course embodying these 
essential features of aim and method, as contrasted with the 
"conventional" course. Tlius the course which adds one or two 
hours of aural or oral practice to the three or four regular 
weekly classes, or the course which covers two or more terms'' 
study in one by increasing the hours per week while not. 
otherwise altering the method, does not constitute an "experi- 
mental" course as we define it. 
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AURAL COMPREHENSION 

Since the aural comprehension tests described in Ghaptei M 
were newly developed, we had to have a standard which would 
render the scores meaningful. It seemed wisest to base this 
standard on the results achieved by conventional instruction 
and to measure those of experimental programs against them. 
We therefore solicited the co-operation of language teachers 
throughout the nation in establishing general norms for our 
tests. Teachers everywhere were invited, through publicity in 
the journals and at association meetings, to use the tests 
free of charge if they were interested in helping with this 
task and in measuring the aural attainments of their students. 
The response was considerable and the demand rose steadily 
between April, 1945, and July, 1947. During this period our 
aural tests were administered in 56 colleges and in 44 
secondary schools, covering all sections of the United 
States.^ In a few institutions located near headquarters, 
members of the Investigation staff were able themselves to 
administer the aural tests. The vast majority of administra- 
tions, however, were handled by the teachers themselves, with 
the phonograph records and supplementary materials (indi- 
vidual test-booklets^ answer-sheets, special pencils) fur- 
nished to them free of charge. 

Table I shows the total tiumber of aural comprehension tests 
administered for the Investigation, distributed according to 
languages and levels and according to conventional and experi- 
mental groups. 

Standardization of the Aural Tests 

As soon as a sizeable body of test scores had accumulated 
the work of standardizing the aural tests was begun with the 
establishment of decile norms for part. and total scores. 
Since the colleges are usually able to maintain relatively 

Ifn addition., taats wara givan in three aehoola in Canada, and in one 
Mexican coilega to American exchange atudentae 
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TABLE 1 

Qmulative Totals of Aural Tests Administered 
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Conventional 


2700 
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1724 


24 


Frtnch 


Experimental 
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11 


314 
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Total 


3354 




2038 






Conventional 


1392 


25 


323 
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Gsrman 
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332 
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Total 


1923 




655 






Conventional 


90 


8 


2-S 
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Russian 


Experimental 


83 
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39 


3 




Total 


173 




59 






Conventional 


5207 


56 


2804 


38 


Spani sh 


Ejq>erimental 


686 


12 


478 


7 




Total 


5893 




3282 





standards of language achievement than the high schools, 
two basic sets of norms were established: one for college 
students and another for students in secondary schools. 

Since frequent mention will be made in the following 
pages of the norms for both the Co-operative Tests and our 
own, a reminder of the caution necessary in using them is 
probably not amiss. At their best the norms for any test 
indicate only the current level of achievement by certain 
classes of students. This degree of attainment may not be 
desirable or even satisfactory. Too frequently an instructor 
comparing the average of his class with national norms loses 
sight of this fact. If his group equals or surpasses the 
national mean or median, he is likely to conclude that he has 
been successful and that his students are learning all they 
need to know. (Yet no teacher would feel equally complacent 
merely because he learned that his salary equaled th 
average national income.) General average performance on an 



64 



AN INVESTIGATION OF SECOND -LANGUAGE TEACHING 



test may be scandalously low; and, whatever the level, 
teachers with superior students, better facilities, and other 
advantages should certainly set their sights higher than run'^ 
of-the-mill performance. Thus while norms serve as a yard- 
stick against which to measure the performance of the experi- 
mental language classes, the scale should not be accepted 
uncritically. Even if the students of the newer programs 
prove to surpass average performance by a considerable amount, 
this fact is not in itself proof that these students have 
necessarily reached a satisfactory level of language pro- 
ficiency. 

(a) College Norms 

As stated in Chapter M, the two levels of test in each 
language were designed to be used with students who had 
accumulated, respectively, totals of 130 or less hours and 
of ISO or more hours. However, as scores from the various 
colleges came in, it became evident tlmt the limits set for the 
respective levels were neither sufficiently tight nor strictly 
enough observed by teachers using the tests. As a result, 
more than one norm-group had to be established for each level. 

Norm^grOups iA, IB, 2. At the lower level. Group 1 con- 
sisted of students tested while taking a beginning course and 
Group 2 was composed of those tested in an intermediate 
course. Group 1 was further subdivided as follows: the 
relatively small number of students who, when tested, had 
received less than 90 hours of instruction were designated 
as Group lA, while the larger number of elementary students 
who had had 90 or more hours were called Group IB. 

Norm^groups il, .12. At the upper level. Group 11 consisted 
of students tested while taking an intermediate course, and 
Group 12 was composed of those tested in an advanced ( third - 
year or higher) course. 

The norms for the lower and upper level forms of the 
French, German, and Spanish tests were based exclusively on 
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scores made by students in conventional courses with classes 
meeting less than six hours per week. These norms could thus 
be utilized as an index of the aural ability of American 
language! students generally, independent of that of students 
specifically taught this skill; and the performance of 
experiiDiintal students could be checked directly against the 
norma 1 s t anda r d . ' 

Table S sets forth the decile norms as established for the 
two levels in French, German, and Spanish. The Russian norms 
are presented separately at a later point. 

TABLE n 

Decile* Norms for Aural Tests -^Colleges 
French, German, Spanish 

OEFDNIITDON OF GROUPS (ALL LANGUAGES) 

riA = Beginning course:- less than 90 hours 

Lower LeveKlB “ Beginning course: more than 90 hours 

[2 ~ Intermediate course 

I'll “ Intermediate course 
Upper LereH 

12 ^ Advanced course 



*It will racaliad that tha nine daeilas art saraly tha linas which 
divida tha continuuH of diatribatad atoras into tan a<iual portions. Thca, for 
axaSpla, tha ninth decila dividaa tha top tantli from tha ninth tanth; tha 
fifth daeila dividaa tha aixth tanth froa tha fifth tanth and than tha top 
Half fron tha botton half; tha first daeila dividaa the second tenth froa 
tha bottom tenth. The raw scoraa ara given for tha most part^ in class 
intervals of two. three or four, for the sake of coapaetnass. Looking at tha 
nora-tabla for French Lower Level, Fora A, wa find for axaapla that in the 
total, th(; score-interval 24-27 is cut by the 7th decile for Group lA, by 
the 5th decile for Group iB, and by the 4th decile for Group 2. This aaanc 
that 70 per cent of the students in Group lA, 50 per cent of those in Group 
IB, and 40 per cent of those in Group IB made total scores ot 24-27 or lower. 

The fifth decile indicates tha median or middle score, which in sya- 
aetrical distributions coincides with the mean or average score. 
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Group 12 = 141 students in 7 colleges 
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GERMAN - LOWER LEVEL 
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Table HI shows the mean scores for both parts and totals 
made by- all experimental students tested, as contrasted with 
the respective mean scores of the two norm*groups with which 
they are jnost nearly comparable. Such comparison excludes 
Group lA at the lower level, since all experimental students 
had accumulated at least 90 hours when tested. Scores of the 
experimental groups are listed between those of the two norm** 
groups, since comparisons should be made in both directions: 
i.e., at the lower level, the experimental groups are almost 
exclusively composed of students taking a beginning course and 
are in this respect comparable to Group IB; at the same time 
many of them have received as many instructional hours as 
students in intermediate courses and are thus comparable also 
to Group 2. The same considerations apply, mutatis mutandis, 
at the upper level. 

In most cases the means of the experimental groups fall 
between those of the two ncrm=groups . Exceptions favor Group IB 
over the experimental in Lower-Level French! (both forms); the 
experimental over Group 12 in Upper-Level Frbnch (Form B only) 
and in Upper-Level Spanish (Form A only). In any case, these 
averages for all the experimental groups combined are provided 
only as a very rough indication of the achievement of experi- 
mentation in- general. They are derived from groups which are 
widely divergent in total hours accumulated, in objectives, 
teaching procedure and the rest; and hence no attempt has been 
made to determine whether any of the observed differences are 
significant — a procedure, reserved for the study of more homo- 
geneous groups in particular programs. 

Russian. The aural tests in Russian were not used widely 
enough to warrant the establishment of more than a single set 
of norms at each level, both conventional and experimental 
groups. Table IV shows the distribution for each level. Only 
the means, reported at the bottom of the columns, distinguish 
between conventional and experimental students. 
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Mean Scores of Norm-Groups and Experimental Groups 



French — Lower Level 
Form A 

Norm-^roup IB (N=1808) 
Experimental grouips (N=498) 

Norm- group 2 (N^lSe) 

Form B ' ' 
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Norm- group 2 (N=54) 
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Norm- group 12 (N=104) 

German — Lower Level 
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Norm- group 2 (NsIyI) 
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■ Form B 
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Experimental groups (N°187) 
Norm-group 12 (Nsl27) 
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TABLE IV 

Decile Norms for Russian Aural Tests 
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(b) Secondary School Norms 

Secondary- school students on each level were classified 
into norm-groups according to the number of semesters completed 
^ or nearly so) at the time of testing. Decile norms were 
established for French and Spanish at both levels (Form A 
only), and in German at the lower level, as set forth in 
Table V. 



TABLE V 



Decile Norms for Aural Tests ^Secondary Schools* 
French, German, Spanish 



Definition of Groups (all languages) 



Lower Level 



OA = one semester 

OB = two semesters (one year) 

OC - three semesters 

00 - four semesters (two years) 

OE ~ five semesters 

OF == six semesters (three years) 



Upper Level 



lOD ^ four semesters (two years) 
lOE. ~ five semesters 
* lOF - six semesters (three years) 
lOG == seven semesters 
lOH - eight semesters (four years) 






*For interpretftt ion of decile tables see note, p. 65* 
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Form A 
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GERMAN - LOWER LEVEL 
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SPANISH — LOWER LEVEL 



Fo rm A 

Group OA ^ 355 students in 5 schools 
Group OB - 743 students in 11 schools 
Group OC - 158 students in 3 schools 
Group OD = 365 students in 10 schools 
Group OE - 27 students in 2 schools 
Group OF - 36 students in 3 schools 
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DECILES 




RAW 






DECILES 




SCORE 


toe 


too 


tOE 1 


lOF 


tOGH 


SCORE 


IOC 


tOD 


tOE 


lOF 


tOGH 


10 










9 


56-58 










9 


9 












52-55 










8 


8 




9 




9 


8 


48-51 












7 












44-47 








9 


7 


6 


9 


8 


9 


8 


7 


40-43 








8 


6 


5 








7 


6 


36-39 


9 


9 


9 


7 


5 


4 


8 


7 


8 


5 


5 


3J-35 


8 


8 




6 


4 


3 


7 


5 


5 


4 


4 


28-31 


7 


7 


8 


5 


3 


2 


5 


4 


4 


2 


3 


24-27 


5 


6 


5 


4 


2 


1 




3 


3 




2 


20-23 


4 


5 


3 


2 


1 


0 


4 


2 


2 


1 


1 


16-19 


7 


3 


1 


1 
















12-15 


2 


2 




















8-11 


1 


1 








Means 


2.3 


3.1 


3.1 4.1 


4.7 


Means 25.4 


24.1 26.5 30.9 


37.8 



: 
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Next to no anral testing was done in Upper-Level German or 
in Russian in secondary schools. Table VI lists the mean 
score? obtained on the Upper-Level German and on the Lower- 
Level Russian tests; 



TABLE VI 

Mean Scores for German (Upper Leve 1) and 
Russian (Lower Level) in Secondary Schools 



German — Upper Level 


PART I 


PART n 


PART m 


total 


Mean, two schools (N~23) 
Russian — * Lower Level 


6.9 


14.2 


5.1 


25.8 


Mean, one school (N^ll) 


3.4 


9.6 


11.3 


24.3 



EVALUATION OF GENERAL AURAL ACHIEVEMENT 
Achievement in Relative Terms 

Before we attempt to discuss and interpret the results of 
the over-all aural testing program in any absolute terms, it 
may be helpful to plot the mean scores of the principal norm- 
groups, in order to point up certain interrelations not only 
of total but of part scores. For each level of French, German 
and Spanish, separate diagrams follow in which the part 
scores of the predominant norm-group (Group IB for the lower 
level; Group 11 for the upper level) are plotted on a straight 
("normalized") base-line. Respective part scores for the other 
norm^groups are plotted according to their deviation (in raw- 
score points) from this base-line. Total scores for all 
groups appear in descending order at the right of each 
diagram, those not plotted being included in parentheses. 
French Lower Level: (See chart on page 81.) 

1. The tendency for all groups to be closest together on 
Part I is observable in nearly all the tests, and may be due 
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FRENCH - LOWER LEVEL (Form A) 



ei 



Group 2 (N=196) 



Group lA (N=44) 
Group IB (N=1808) 
Group OC-D (N=98) 
Group OB (N=305) 



PART I 


PART n 


PART m 


(14.4 000000 (13.21 




14.2 


13.0 




14.0 


12.8 


(HD® 


13.8 


12.6 


6.4 


13.6 


12.4 


6.2 


13.4 


12.2 


6.0 


13.2 


12.0 


5.8 


13.0 


11.8 


5.6 


12.8 


11.6 


5.4 


12.6 


11.4 


5.2 


12.4 


11.2 


5.0 


12.2 


11.0 




12.0 


10.8 


4.6 1 


11.8 


10.6 



TOTAL 

2: 33.9 



c4.4n i ^p CTTr^V "'" ' <10.41 
4.2 \ X 11.4 \ 10.2 

3.8 \ 



IB: 2). 4 



\\ 



\ 



11.2 


\ 10.0 


OC-D: 25.1 


11.0 


XO) 




10.8 


9.6 




10.6 


9.4 




10.4 


9.2 




10.2 


9.0 




10:0 

9.8 


03) 
/ 8.6 

/ 8.4 
/ 8.2 
i 8.0 


lA: 21.9 


9.6 


OB: 19.1 




OA: 17.9 


\ 9.0 \ 


/ 7.8 


(Parts not shown) 


i 8.8 > 


' 7.6 




' 8.6 / 


\ 7.4 




toy 


\ 7.2 






\ 7.0 











to psychological factors. Nervousness and confusion at the 
beginning of the test may well have lowered the scores of 
many students capable of better response, and may thus have 
reduced the spread at this point. (That Group lA is actually 
higher than IB on Part I is probably attributable to the fact 
that lA represents a very small sample as compared with IB.) 
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GERMAN - LOWER LEVEL 



Group (DD (N=32) 



Group 2 (N=171) 



Group IB (N'-473) 



Group OB (N=160) 



Group lA (N=300) 



PART I 
9.2 o 

9.0 % 
8.8 % 
8.6 % 



PART n 



PART in 




• 6.6 

6.4 

6.2 

6.0 

5.8 

5.6 

dUK 

5.2 \ 
5.0 \ 



7.2 

7.0 
6.8 
6.6 

6.4 

6.2 

6.0 
5.8 
5.6 

5.4 
5.2 






9.4 

9.2 

9.0 
8.8 
8.6 

8.4 

8.2 

8.0 
7.8 
7.6 

7.2 

7.0 

'"> 03 ) 



TOTAL 

OD: 27.3 



2: .26.5 



IB: 23.4 



OB: 17.5 
lA: 15.8 



OC: 13.1 

(Parts not shown) 



i 
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SPANISH 



LOWEB LEVEL (Form A) 



Group 2 (Ns563) 



Group OD (N=365) 



Group IB (Nsl412) 



Group lA (N=31) 
Group OB (Ns743) 



PART I 



7.4 

7.2 

7.0 
6.8 
6. 6 

o. ^ ^ 

6.0 ' 

5.8 

5.4 

5.2 
5.0 

4.8 
4.6 



part ul 

*' 12.8 
12.6 

12.4 
12.2 
12.0 
11.8 
11.6 

11.4 
11.2 
11.0 

, 10.8 




GUl 

4.2 \ 
4.0 \ 

\ 



10.2 

10.0 

9.8 

9.6 

9.4 

9.2 

9.0 

8.8 

8.6 

8.4 

8.2 

8.0 
7.8 
7.6 



k t 0.0 I 

\\ 8.4 / 

i\ 80 / 

A !' / 

\'ct 

\ 7.0 






PART m 

15.6 

15.4 

15.2 

15.0 

14.8 

14.6 

14.4 

14.2 

14.0 

13.8 

13.6 

13.2 

13.0 

12.8 

12.6 

12.4 
\ 12 . 2 

11.8 

11.4 

11.2 

11.0 
10.8 
10.6 

10.4 
10.2 
10.0 

9.8 

9.6 
9.4 
9.2 
9.0 

8.8 

8.6 

4 



V 8. 



TOTAL 

OF: 51.9 

(Parts not shown) 

2: 35.8 

OE: 32.3 

(Parts not shown) 



OD: 28.3 



la* 29.4 

OC: 24. 9 

(Parts not shown) 



lA: 22.9 



OA: 18.7 

(Parts not shown) 
(B: 18.2 
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2. Students tested before the end of the first year, 
whether in high school (OB) or in college (lA) are compara- 
tively low on Part I (Phonetic Accuracy). 

3. The high=school groups run lower on Part H, Anecdotes, 
than the corresponding college groups. This tendency is 
observable in connection with other languages, and may be 
attributable to at least two factors in the high school as 
contrasted with the college situation: (1) aural practice in 
high-school classes tends to be based more often on short 
segments of speech (words or phrases), and less often on 
passages having the length of anecdotes; (2) the average 
high-school student is less mature and hence less able to 
interpret the relatively sophisticated content of some of the 
anecdotes . 

German Lower Level: (See chart on page 82.) 

1. That Hi^-school Group OB perfommed better than College 
Group lA and that High-school Group OO did better than College 
Group 2 are due merely to sampling error. 

2. Group OC, with the lowest total score, is a small sample 
from a single high school. 

Spanish Lower Level; (See chart on page 83. ) 

1 . The tendency, noted in French (Lower Level), for high- 
school groups to be less successful than college groups on 
Part M is clearly seen in the contrasts between Groups lA and 
OB and between IB and OD. 

2. Although Groups OA (N=355) and OB (N=743) axe both 
largish .samples, the total-score difference of .5 favoring the 
group with less instruction is not significant. 

3. A very sharp upswing from the normal range of the means 
is to be noted in Group OF (not plotted) . This group is not to 
be regarded as typical of third-year high-school students, as 
it consists largely of selected students competing for scholar- 
ships . 
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FRENCH • UPPER LEVEL (Form 



Group 12 (N=141) 



Group 11 (N=777) 
Group lOF (N=30) 



part I 


PART n 


PART in 




/ 23.4 » 






23.2 \ 
23.0 \ 
22.8 \ 




goy 




13.8 




13.6 


22.6 


1 


13.4 


22.4 




13.2 


22.2 


\ 

\ 


13.0 


22.0 


\ 

\ 


12.8 


21.8 


\ 

\ 

\ 


12.6 


21.6 


12.4 


21.4 


\ 

\ 


12.2 


21.2 


\ 

\ 

\ 


12.0 


21.0 


11.8 


20.3 


s 


11.6 


20.6 


\ 

'(O) 


11.4 


20.4 


11.2 


20.2 


5.6 


11.0 


20.0 


5.4 


10.8 


19.8 


5.2 


10.6 


19.6 


5.0 


10.4 


19.4. 


4.8 


10.2 


19.2 


4.6 


10.0 


19.0 


4.4 


9.8 


18.8 


4.2 


9.6 


18.6 


4.0 


9.4 


18.4 


3.8 


9.2 


18.2 


3.6 


9.0 


18.0 


3.4 








A) 

TOTAL 



12: 43.0 



11: 29.4 
lOF: 28.6 



Group lOD (N=72) 



lOD: 21.9 
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SPANISH - UPPER LEVEL (Form A) 



Group 12 (N=302) 



Group lOF (N=140) 
Group 11 (N=1044) 



Group lOD (N=418) 



PART 



PART ni 




TOTAL 



12: 40.1 



lOG-H: 37.8 
(Parts not shown) 



11: 35.2 
lOF: 30.9 



lOE: 26.5 
(Parts not shown) 



IOC; 25.4 
(Parts not shown) 



lOD: 24.1 
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French Upper Level: (See chart on page 85.) 

1. High-school Group lOF (three years) and College Group 11 
(intermediate), which closely parallel each other, show their 
maximum divergence in Part 1 (Anecdotes). This same tendency 
has already been noted in regard to the lower level. 

2. Part II (Dialogue) is not only the most difficult section 
of the test to handle, but also has a small range of only 
15 points. With the exception of the advanced college group, 
this part failed to spread the groups appreciably. 

Spanish Upper Level: (See chart on page 86.) 

1. .The tendency for the high-school groups, as contrasted 
with the college groups, to make low scores on Part M (Anec- 
dotes) is seen the most clearly in this picture. 

2. As in French (Upper Level), Part II failed to produce 
any noteworthy spread. 

We may now sum up our observations of main tendencies as 
follows: 

1. At the lower level. High-school Group OD (two years) 
and College Group IB (one year) approximate the same level 
of achievement. One year of high school seems not to produce 
as high results, 'however, as one semester of college (French, 
Spanish) . 

2. At the upper level, High-school Group lOF (three years) 
and College Group 11 (two years) are close to the same level. 

3. At both levels, most groups show comparatively little 
spread in Part I, perhaps because of failure on the part of 
the more nervous students to respond at full capacity. 

4. At both levels, high-school groups are less successful 
on the anecdote sections than college groups, perhaps because 
greater maturity is required to understand some of the anec- 
dotes and because they have had less experience with long 
passages. 
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Achievement in Absolute Terms 

In order to see the over-all aural achievement of the 
Ainerican language student, as measured by the Investigation 
tests, we may examine the results for important norm-groups, 
in terms of percentage of correct response. At the lower 
level we will most profitably consider the attainments of two 
groups, students who have conqpleted one year, and two years of 
college study. 2 Within the corresponding norm-groups .( IB and 
2), the eighth decile indicates the score at or below which 
eighty per cent of the students stood, while the fifth decile 
will indicate the median score, which fifty per cent of the 
students failed to c^xceed. In Tables VI- 1 and VH-2 we set 
opposite each score the percentage of the items answered 
correctly by the students making these scores. 

Achievement at both the eighth and the fifth decile was 
generally higher on the upper-level than on the lower-level 
tests. Although it is possible that the lower-level tests were 
relatively harder tests, there is nevertheless good reason to 
see in these figures a proof that aural skill is acquired 
slowly and increases toward the end of two years* study. This 
conclusion is further confirmed by the notably higher per- 
centages attained by the advanced (third-year) groups in 
French and Spanish. 

Certain comparisons which we are about to make among per- 
formances in different languages are subject to extremely 
cautious interpretation. While identical levels of difficulty 
in all languages were aimed at in the construction of the 
tests at each level, there is no ground for assuming that 
results can be considered any more than approximately com- 
parable. J^urther variables in this situation are the un- 
measured differences, in background, intelligence, and the 
like. 

^High-tchool ‘groups are not included! in the present data; the interested 
reader can melke hie own comperieona for any groups by consulting the high* 
school norms or the charts on pages 81 * 86 . 
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TABLE VI -1 



Percentages attained at 8th and 5th deciles 
Lower Level 



French (Form A) 



Part I 
Definitions 
MAXIMUM 



Part I 
Phonetic 
Accuracy 



Part M 
Anecdotes 
MAXIMUM 



Total 



MAXIMUM 







POSSISLE 


28 


MAXIMUM 


POSSIBLE 


41 


POSSIBLE 












POSSIBLE 


so 












DECILE 


SCORE 


% 


SCORE 


% 


SCORE 


% 


SCORE 


% 


Group iB 


8th 


7 


28 


17 


57 


16 


39 


36 


37 


5 th 


4 


16 


11 


37 


10 


24 


25 


26 


Group 2 


8th 


11 


44 


20 


67 


21 


51 


47 


49 


5th 


6 


24 


14 


47 


12 


29 


32 


33 


German 




Part 1 




Psrt I 




Part n 


Total 








Completions 


Definitions 


Anecdotes 










MAX 1 MUM 


MAXIMUM 


MAXIMUM 


MAXIMUM 






POSSO &LE 


28 


POSS 1 BLE 


28 


POSSIBLE 


SB 


POSSIBLE 


88 




DECILE 




% 


SCORE 


% 


S CORE 


% 


SCORE 


% 


Group IB 


8th 


12 


48 


12 


48 


16 


44 


37 


43 




5th 


6 


24 


7 


28 


8 


22 


19 


22 


Group 2 


8th 


13 


52 


13 


52 


18 


50 


39 


45 


5 th 


8 


32 


7 


28 


9 


25 


23 


27 


Spaniih (Form A) 


Part I 




Part 1 




Part M 










Completions 


Definitions 


Anecdotes 










MAXIMUM 


MAX IMUM 


MAXIMUM 


MAXIMUM 






POSSIBLE 


28 


POSSIBLE 


28 


POSSIBLE 


38 


POSSIBLE 


• 8 




DECILE 


SCORE 


% 


SCORE 


% 


SCORE 


% 


SCORE 


% 


Group iB 


8th 


9 


36 


14 


56 


19 


50 


39 


44 




5th 


5 


20 


. 10 


40 


13 


40 


28 


32 


Group 2 


8th 


12 


48 


18 


72 


23 


61 


50 


57 




5th 


6 


24 


12 


48 


15 


39 


33 


38 
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At the upper level range | the groups considered are (1) stu- 
dents w^'O have completed no more than two years, (2) students 
who have completed more than two years of college study. The 
corresponding norm~groups are II and 12. 



TABLE VI- 2 



Percentages attained at 8th and 5th deciles 
Upper Level 



French (Form A) 


Part I 


Part 


n 


Pait 


mu 


Total 








Definitions 


Anecdotes 


Dialogue 










MAXIMUM 


MAXIMUM 


MAXIMUM 


MAXIMUM 






POSSiSLE 2S 


POSSOBLE 


40 


POSSIBLE IS 


POSSIBLE 


• 0 




DECOLE 


SCORE % 


SCORE 




% 


SCORE 


% 


SCORE 


% 


Group 11 


8th 


14 56 


24 




60 


6 


40 


41 


51 




5 th 


8 32 


18 




45 


2 


13 


27 


34 


Group 12 


8th 


20 80 


33 




82 


9 


60 


59 


74 




5th 


14 56 


23 




58 


6 


40 


43 


54 


German 




Part I 


Part 


I 




Part 


miff 


Total 








Definitions 


Anecdotes 


Dialogue 










MAXIMUM 


MAX 0 MUM 


MAXIMUM 


MAXOMUM 






POSSIBLE 25 


POSSIBLE 


40 


POSSIBLE IS 


POSSIBLE 


to 




DECILE 


SCORE % 


SCORE 




% 


SCORE 


% 


SCORE 


% 


Group 


8th 


10 40 


23 




58 


9 


60 


40 


50 


11-12 


5th 


6 24 


13 




32 


6 


40 


22 


28 


(Combined) 


















Spanish 


(Form A ) 


Part I 


Part 


I 




Part 


H 


Total 




Definitions 


Anecdotes 


Dialogue 










MAXIMUM 


MAXOMUM 


MAX IMUM 


MAX IMUM 






POSSIBLE 25 


POSSOBLE 


45 


POSSIBLE IS 


POSSIBLE 


as 




DECILE 


SCORE * 


SCORE 




% 


SCORE 


% 


SCORE 


% 


Group 11 


8 th 


13 52 


28 




62 


8 


53 


46 


54 




5 th 


8 32 


21 




47 


4 


27 


34 


40 


Group 12 


8th 


16 64 


31 




69 


7 


47 


52 


61 




5 th 


12 48 


25 




56 


4 


27 


38 


45 
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With these reservations in mind, we may observe at the 
lower level a generally weaker performance in French than in 
the other languages. This is apparent even in the totals at 
the eighth decile, though at the fifth decile only examina- 
tion of the part-scores will reveal the French as essentially 
weaker than the German. That is to say, the French scores are 
disproportionately high on Part II, the section measuring 
Phonetic Accuracy (which appears only in the French test). 
This part requires the matching of very short sequences 
of phonemes with one of four printed units. Correct re- 
sponse thus does not demonstrate the kind of aural com- 
prehension which is measured by completions, definitions 
or anecdotes, that is to say, both the apprehension and 
the interpretation of utterances of several words. Since 
French orthography is extremely inconsistent with the spoken 
form, some training in the matching of sounds and letters is 
necessarily given to students of French even in courses not 
aiming at any high development of aural skill. Most students 
can distinguish short sequences of sounds (especially when 
these sounds need not be interpreted, i.e., related to some 
meaning) , and their ability to do so is revealed among the 
Part M scores even of those who have little ability to compre- 
hend sustained utterances. All students of a language work 
largely with its written form; and in French, because of the 
differences between the written and spoken 'forms, students 
doubtless need longer and more rigorous training in aural 
comprehension than do learners of other languages such as 
German and Spanish. The upper-level French percentages show, 
moreover, that in the long run students do learn to understand 
spoken French as well as spoken German or Spanish; and if we 
are to give weight to the percentages attained by French 
Group 12, it would appear that advanced students of this 
language even surpass students of other languages in aural 
ability. It may be that once the initial phonetic difficulty 
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has been hurdled in French, its basic lexical and syntactic 
patterns make it an easier language than some others for 
English speakers to understand. 

In German, the lower-level scores are higher on Part I 
than in Spanish, but lower on the other parts of the total; 
the upper- level scores are the lowest of the three languages 
except on Part M, the Dialogue. The German samples tend to 
be small, and it is probably not safe to conclude that there 
is significance in these particular differences. However, a 
partial explanation may lie in a difference of style between 
colloquial and formal (written) idiom which is greater in 
German than in French or Spanish. As we mentioned earlier, the 
anecdotes in the German tests are bookish in character, and 
may have presented patterns of style which more than ordinarily 
baffled the listeners. In confirmation of this hypothesis the 
percentages on the upper- level German dialogue, which is con- 
siderably more colloquial in its phrasing than the anecdotes, 
are higher than any other Part II percentage except those of 
French Group 12. 

In Spanish the percentages are consistently higher than in 
the other languages in all but the upper -level advanced group, 
where they fall short of the corresponding French figures. 
This pattern suggests the hypothesis that students of Spanish, 
aided By a reliable correspondence between its spoken and 
written forms , develop a minimum of aural control relatively 
early but do not thereafter increase this control proportion- 
ately with students of French. 

Aural performance in Russian cannot be fairly compared with 
that in the three more widely taught languages. The percentages 
of achievement for the total tests in Russian are as follows: 
Lower Level - 8th decile, 76%; 5th decile, 43%; Upper Level- 
8th decile, 74%; 5th decile, 57%. Several factors make the 
situation different in Russian. Classes are small and student 
motivation is high; virtually no one takes Russian merely in 
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order to fulfill a language requirement. Those who elect 
Russian have their own reasons for doing so, usually related 
to their future careers or theip cultural interests or back- 
grounds. Many of them are of Russian, Ukrainian or Polish 
extraction and have heard, if not actually spoken, in their 
homes one or another of the closely related Slavic tongues. 
Those who have not this advantage are apt already to have 
studied one or more foreign languages, and they come to Russian 
with a proved interest in, and aptitude for, foreign- language 
study. Russian is popularly believed to be an extremely diffi- 
cult language for speakers of English to master, and few 
students attempt it who do not know in advance that their 
chances of success are better than average. 

The predominantly low ranges of scores, in all the lan- 
guages at both levels, demonstrate clearly enough that the 
average American student of a second language is not equipped 
at the end of one, two, or even three years of college study 
to understand adequately a native speaker transmitting un- 
familiar material through a mechanical medium. Combining all 
three languages and both levels, we find that at the 8th 
decile the percentages range from a high of 74% to a low of 
37%, and that at the 5th decile (the median) they range from 
a high of 54% to a low of 22%. Furthermore, a glance back at 
Table M (page 72) shows us that the average student in a 
current experimental course — a course in which he is trained 
through special methods to handle the spoken form of the 
language, and can allegedly comprehend with complete facility 
familiar sequences of speech uttered by speakers who are also 
his teachers — is no more successful than the conventionally 
taught language student when confronted with an instrument 
designed to measure his aural ability in absolute terms. 

Let us attempt to examine the factors contributing to the 
equal insuccess of conventionally taught and aurally trained 
students. In the case of conventionally taught students, the 
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basic cause is quite simple: their aural training has been, 
at worst, non-existent, and at best casual or inadequate. In 
many so-called reading-courses there is frankly no other 
objective than ability to interpret the printed page; in 
others there is "oral-aural practice" in class, which probably 
consists mainly of oral reading and contributes little to the 
development';, of aural skill, especially if the students hear 
each other’s accents more than the teacher’s. In the so- 
called "all-purpose" or "eclectic" course, where aural ability 
is claimed as one of the objectives, the most skillful and 
well-meaning teacher has all too little time to devote to the 
painfully slow process of training his students’ ears. Further- 
more if this teacher is not a native speaker of the language, 
even if he devotes a maximum of time and energy to aural 
training, the students are apt to end up understanding him 
but no one else. Before being exposed to the Investigation’s 
aural tests, many students have never heard a foreign language 
reproduced mechanically; they feel (and are) at a disadvantage 
when faced with a phonograph record. But if they have never 
heard native speakers, they would not perform with notably 
greater success if the person who made the recordings were 
to step before them and deliver the test himself, with 
gestures,. 

The students aurally trained in current experimental 
courses obviously enjoy advantages which the other students 
lack. They hear the language daily in their drill sessions, 
and are trained to understand native speakers at a regular 
conversational speed. Yet these advantages are offset by 
another factor, the ultimate effect of which is to reduce them 
to the same level of non-comprehension (so far as the tests 
are concerned) as the untraincd^group. The topics discussed in 
their conversation practice — menus, markets, and motors — are 
not the subjects treated in the definitions and anecdotes 
of the aural tests, and the vocabularies are to no small 
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extent different.^ Thus their scores could hardly have been 
perfect^ even if they had understood every word *“ and every 
sequence of words ■= which they had met and learned in their 
oral=aural work. It is evident, however, that regardless of 
how many known words they actually apprehended, they did not 
comprehend the total flow of speech as a whole. ^ That is, 
instead of "hanging on" and filling in from the context and 
from inference the gaps caused by unfamiliar words, they 
missed the small structural words (those which give precise 
form to an utterance), were disconcerted by the occurrence of 
unknown words, and so lost the continuity of the sentences 
and anecdotes. And it is safe to assume that they failed of 
over-all comprehension because, despite their special training, 
they were still far short of having acquired near-native skill 
in aural comprehension. 

It would have been interesting to learn exactly how high a 
level of performance would be reached by a representative 
sample of persons having complete native control of the 
language tested. Such a group would not, of course, all 
achieve perfect scores for at least two reasons: (1) failure 
to remain completely attentive throughout the test, and 
(2) failure to cope unerringly with the mechanics of the test 
and to handle the English answer choices within the time- 
limits imposed. In any case, no such group of bilinguals was 
accessible. We did, however, have the opportunity to test 
several hundred Spanish students in the southwestern United 
States who came from Spanish- language backgrounds. Both 

the range of overlap cited in Chapter Mf p. 47. 

they had, we estimate that the incidence of unknown words would have 
held their poaaible maximum performance to roughly 80%. We sought data on 
which to base this estimate by giving the Spanish tests (both levels, Form A) 
to a person who knew no Spanish whatever, translating into English as we 
read the material all the words occurring in Trevino’s Spoktii Spanish, The 
resulting total scores were 66 on the lower-level (75%) and 70 on the upper- 
level test (82%). 
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college and high^school groups were tested at each level. 
Scores and percentages obtained were as follows: 

8th decile 5th decile Mean 
Lower Level • College Group (N=44) 82 (93%) 74 (84%) 73.9 

Lower Levels High- School Group (N=267) 62 ^0%) 50 (57%) 47 ! 8 

Upper Level- College Group (N=62) 74 (87%) 68 (70%) 65.2 

Lower Level - High-School Group (N-233) 53 (62%) 46 (54%) 42.7 

None of these groups could be considered homogeneous in 
competence. The college groups were more so than the high- 
school groups, and their greater success on the tests, at 
either level, seems due in part to this factor. All* were 
about equally competent in English; some spoke Spanish in 
homes at least moderately cultivated; others, while not 
fluent themselves, associated frequently with native speakers 
and understood the language with considerable facility. It is 
noteworthy that the lower- level group was more successful 
than the upper- level group, a fact which at once suggests 
that students of this type command a somewhat limited 
vocabulary. 

The high-school ' students tested were classified w’ithin the 
school system as "Spanish-speaking." We may suspect that this 
distinction is not entirely linguistic, however, and that 
etlmic arid social factors play some part. Some of the students, 
while they had Spanish names, performed as though they knew 
very little Spanish. It was their scores which brought the 
group means below the medians. Many of them doubtless came 
from families who no longer used much. Spanish in the home, 
at least with the children; others of them probably had 
limited control of English. The majority of them, moreover, 
belonged to a social group having relatively little breadth 
of culture;: this meant that their Spanish was probably limited 
to a vocabulary of a few hundred words, not greatly expanded 
since early childhood. Even on the lower-level test, half of 
them understood only 57% or less of the material. 
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Even though the southwestern students tested in Spanish 
could not aualify as native speakers of. the language, they 
assumedly possessed greater aural skill than the typical 
American student. In the light of this assumption, their 
superior performance on the aural tests indicates a positive 
correlation between the ability to understand Spanish and 
success on these tests, however imperfect they may be. And 
though reflecting two rather distinct levels of aural skill, 
the two "Spanish-speaking" groups tested both stand between 
two extremes: that of the fully competent native speaker on 
the one hand, and the average American student of a second 
language on the other. 

ORAL PRODUCTION 

While the country-wide response to publicity regarding our 
aural comprehension series was considerable, there was 
comparatively little demand for the oral production tests. 
For one thing they were not completed and available until 
late in the academic year 1945-1946 — approximately a year 
after the aural tests went into use. This lateness combined 
unfortunately with the great difficulties involved for any 
teaching staff in setting up a schedule for the administra- 
tion of the tests. 

Since the tests require fifteen to twenty minutes for each 
student, it was out of the question to attempt any large- 
scale use of them. Even in the centers collaborating especially 
with us to furnish large bodies of asserted data, it was 
impossible to develop a concerted plan. The most that we ac- 
quired was a sampling, which was haphazard even in the case 
where we ourselves spent two days on a campus doing the 
testing. A further disturbing factor was the propensity of 
teachers to select as samples, when full groups could not be 
tested, students whose ability to speak the language was 
better than average for their group. Also, in one college 27 
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out of the 56 students tested at the upper level were ad- 
vanced students, and some of those 27 were language majors 
taking junior or senior courses not included at all in our 
aural and visual testing program at that college. Again, 16 
intermediate students at that same college were given the 
lower-level instead of the upper- level test. Thus the 
ranges of scores obtained would undoubtedly be lower than 
they are if the student samplings had been more representative 
of poor, average and good students and had been less heavily 
weighted with advanced students. 

The following table shows the extent of the oral testing 
program, which consisted of samplings of both conventional' 
and experimental students. 



LOWER LEVEL 



UPPER LEVEL 



French 

German 

Spanish 



Number of 
Case* 

23 

27 

43 



Number of 
Inetitutions 

2 

4 

4 



Number of 
Caeee 

51 

33 

26 



Number of 
Institutions 



4 

3 



For obvious reasons we made no attempt to standardize the 
oral tests. Table YU shows the mean scores obtained for the 
separate parts on each test, with percentages given in 
parenthesis after each score to indicate the actual level of 
performance. 

At the lower level the scores on all three parts of the 
test are lowest in French and highest in Spanish. Although, as 
we shall see in a moment, all the scores are of somewhat 
dubious validity, the contrasts among the scores for the three 
languages at the lower level may possibly be regarded as 
indicative of relative degrees of difficulty inherent in the 
earliest oral efforts in these three languages. Problems of 
pronunciation certainly loom larj^^st in French, and are 
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TABLE VII 



Oral Production Tests: Mean Scores (Raw) for All Groups Combined 





Part I 

Picture Series 


Part 1 

Sustained Speech 


Part 

Conversation 




MAXIMUM POSSIBLE 

40 


MAXIMUM POSSIBLE 

8 


MEAN 


MAX. 

POS. 


French 

Lower Level (N'^3) 


12.3 (31%) 


3.3 (41%) 


24.1 (30%) 


80 


IL^per Level (N=51) 


18.7 (47%) 


4.8 (60%) 


36.7 (46%) 


70 


German 


Lower Level (N=27) 


14.5 (36%) 


4.2 (53%) 


35.4 (37%) 


96 


tapper level (N=33) 


21.9 (55%) 


6.4 (80%) 


51.9 (58%) 


90 


Spanish 


Lower Level (N=*43) 


25.5 (64%) 


5.1 (64%) 


35.5 (51%) 


70 


Upper Level (N=^6) 


23.7 (59%) 


5.1 (64%) 


34.2 (50%) 


68 


perhaps greater 


than those of 


inflection and 


word-orde 


r in 



(simple) German; Spanish is relatively easier, both phonet*^ 
ically and syntactically, in the earlier stages. The con- 
trasts among scores from language to language are not as 
marked or as consistent at the upper level, thus perhaps 
reflecting the existence of lesser difficulty differentials — 
though not of decreasing difficulty — in the intermediate 
and advanced stages of oral development. 

It will further be. noted that the performances on Parts I 
and M are very close together in both levels of French and 
German, while in Spanish Part I runs higher than Part H. 
This may mean simply that in French and German the parts were 
of about equal difficulty but that in Spanish, Part I was 
easier. In Parts I and M samples of acceptable response were 
furnished for each item on the rating sheet, and with these 
guides most administrants were able to judge the responses 
item by item with passable reliability. On Part H, however, 
useful models for the production of sustained speech could 
not efficiently be supplied; thus, despite the rating scale 
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supplied, examiners necessarily relied on the standards of 
excellence they were accustomed to set for their own students 
with respect to fluency, vocabulary, pronunciation and 
grammar. It is rather unlikely that a given student’s produc- 
tion would vary greatly in quality from one part of the test 
to another, and especially unlikely that he would perform 
more expertly on the one section in which he had to formulate 
his own ideas as he talked; hence we are inclined to see in 
the relatively high Part H scores a failure of the examiners 
to rate as objectively as tm the other parts. 

We ourselves administered the oral tests in one college 
and in one high school, while in a second college the students’ 
production was recorded on discs and sent to us for rating. 
The scores we assigned tended to be lower than those given by 
local administrants , and were consistently so on Part H. Below 
are transcripts of the production of three students who took 
the lower-level Spanish test in College A, and of three who 
took the upper-level German in College J.^ 

Samples of Spanish Oral Production 

The Spanish students were completing a one-year beginning 
course which met five hours per week. This course was of the 
conventional type, in which nevertheless there was an attempt 
to develop oral and aural skills as much as possible. The 
responses on the oral test were recorded on discs, and scored 
by the Investigation staff. The students are designated 
respectively as A, B, and C. Their responses appear in the 
right-hand column opposite those suggested as a standard in 
the rating-sheet for examiners. 



Slhe programs of theae colleges are dlescribedl in Chapters V and VI. 
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PART I 



Picture Series: 40 points 
A’s score: 21 
B*s score: 17 
C’s score: 11 



i 

! 

I 

^ Standard Response 

1. Los niffos estan jugando al tenis. 

2. La mujer esta comiendo fruta. 

3. El muchacho est-^ vendiendo 
periddicos . 

4 . La criflidft 95ta lavando loa platos. 

5. La gente va a la igleaia. 

6* La f annilia as ta eacuchaindo el radio. 

7. El joven ae deapierta. 



Recorded Re$pome$ 

A: Loa ninSa eatan jugando. 

B: Loa muchachoa ea ta j ugando e 1 
tenia . 

C; Loa doa chicoa juguen el tenia. 

A; La muchacha.. (ah) . .comiendo .. 

(no)., come fruta. 

B: La muchacha come .. (ah)... 

C: La muchacha com^ la fruta. 

A: El muchacho vende los periddicos. 
B: El muchacho venden el diario. 

C: El chico vendd el periadico. 

A: La criada lleva las platas. 

B: La criada llavan los plet/... 
platos . 

C: La muchacha lleva la ... 

A: La familla van ... va a la igleaia. 
B: La gente van a la iglesia. 

C: La gente van a la ingles. 

A: La familia escuchando ... (no) ... 

escuchan a la radio. 

B: La familia echan el radio. 

C: La familia escuchan el radio. 

A: El muchacho despiert/. ..se 
despierta . 

B: El muchacho se despierta. 

C: El chico se desperte. 



O 

ERIC 
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i. 



ll 



i 



8. Los niHos sslen de la escuela. A: 

B: 

C: 

9. El kombre corre hacia el autobus. A: 

B: 

C: 

10. El perro tiene un zapato en la boca. A: 

B: 

C: 

11. La cbica esta cogiendo flores. A: 

B: 

C: 



12. Los soldados estan marchando. A: 

B: 

C: 

13. El artista esta pin.tando un A: 

cuadro. B: 

C: 

14. La maestra esta escribiendo en el A: 

tablero. B: 

C: 

15. La taza esta rota. A: 

B: 

C: 

16. La cbica baja la escalera. A: 

B: 

C: 



Los niSifos andan. 

Los muchachos van a la escuela. j 

Los alumnos salen a la escuela. 

La mucha/. . . (or) El muchacbo esta 
coriendo a la bus. 

El muchacbo ... 

El chico esta corriendo a coche. 

1 

El pero tiene un [z]apato^ en 
el ... en la boca . 

El perrito lleva la zapato. 1 

El pero tiene un [Xlrape. | 

I 

La muchacbo coge los flores. 

La muchacha coge los flores. ! 

La muchacha es ... picar las 
flores . 

Los soldados son marchando. 

Los soldados marcha. 

Los soldados estan marchando. 

El hombre pinta. 

El artista pinta el retrato. 

El chico pinta el carta. 

I 

La profesora escribe en la pizarra. | 
La profesora escriba la leccion. | 

La profesora escribe la leccidn en j 

el pi[z]ero. | 

i 

\ 

La disca es rota. ^ 

i 

La taza echan per/... pedazos. 

s 

* * * i 

La muchacha va a la baja. | 

La muchacha ... 

La muchacha . . . es ...s/... 



^Hatters in brackets are phonetic representations of sounds not occurring in Spanish. 



!' 

i 



i; 
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17. El hombre esta encendiendo su 
cigarro. 



18. El aeSor ae pone el abrigo. 



19. El niRo ae acueata. 



20. El cartero esta llamando en la 
puerta. 



A: El Caballero f ueg/. . .£ uegue el 
cigaro. 

B: El Caballero esta fumando. 

C: El muchacho fiuma cigarillo. 

A: El hootibre mete la Abrigo ... el 
abrigo. 

B: El setior lleva el abrigo. 

C: El pobre es se vesti. 

A: La nilna se ... ac/. . . acoste . 

B: La muchacha . . . 

C: El muchacho se acuesta. 

A: El hombre de la c/. . . las cartas 
llama a la puerta. 

B: El hombre llama a la puerta. 

C: El muchacho llama a la puerta. 



PART 1 

Sustained Speech: 8 points 

A's score: Fluency 1, Vocabulary 1, Pronunciation 2, Grammar 1. 

B’s score: Fluency 0, Vocabulary 1 , Pronunciation 0, Grammar 1. 

C s score: Fluency 0, Vocabulary 1, Pronunciation 0, Grammar 0. 

Stimulus: *You are talking with 'a Spanish-speaking person who has never been 
to the United States. Describe to him the town or city in which you live." 
Second stimulus (if necessary): "This person is also interested in what a. 
North American home looks like. Describe to him the home in which you (or 
your parents) live.” 

k 

I 

I A: ” OPlace-name] es una. . .(ah) . . .ciudad muy hermosa. Tiene un popiulacion de 
trescientos mil. Es una ciudad sichuada en muchas mohtaffas (laughs) y es... 
(ah)... y tiene una rfo: el rfo que coriendo en la... en medio de la ciudad. 
Tiene una catedral que es muy hermosa y es muy famosa en la pais. Es la 

capital de la... es/.. de... del Estado Los edificios son... no 

es muy largos; es... tiene... tienen dies, y cuatorce, y mas quince pisos. 
Las calles coriendo. .." [iVext stiaulue] "Mi casa... tiene siete . . . ( ah) . . . 

I habitaciones. Es... tiene dos pisos y es de...(ah)... madera. Es amarillo, y 
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se es/...ta aichuada en e/... encima de un... encima de un gil. Tiene muckas 
... (ah)... ventanas que son muy largas y imiy bonitas. " 

E: "El pueblo donde vivo esta muy pequeKo. La calles as/...asta larga y 
estrecha. Latt casas asta antigua. Las calles tienen. {.Next stimulus] "La 
casa donde vivo asta pequeHo. La casa est£ rodeado por un jardin. El jar . . . 
En el jardfn hay £rboles, floras; floras son de colores de rojo, azul, 
amorilla, y. . . (ah) . . .esta primavera los arbol/. ..las arboles ast£. .. ast£n 
Verdes. La casa. .. (ah) ... tiene. .. (ah) .. . seis cuadros: la cdcina, la sala, 
tres... £lcobas..., y un cuadro de baKo. En la sala esta dos silldns, un 
piano, un gran alfambra..." 

C: "[place-name] est£ sichuado en el lago de Tiene. 

papiule[s] ion mil quinientos vente, y es un poblaLs]ion muy hermosa. En el 

pobla[s]ion hay muchas cosus hacer. Estoy ya no viviendo en Mi 

madre y mi padre estan viviendo alii. Hay muchos barcos en el lago.” [Next 
stimulus] ”Mi madre y mi padre viven en una casa sichuada al...en el calle 
de Oak. La casa no es muy grande pe'rb airve... les sirve muy bien. La casa 
tiene dos pisos y cuatro cuadros en cada piso.” 



PART II 

Conversation: 70 points 

A*s score: 43 
B's score: 27 
Cs score: 13 





V = Voice on record 






R - Standard response 


Recorded Responses 


V: 


0 Bueno, cdmo le va? 




R: 


Estoy cansado y me duele un poco A: 


Muy bien. . . ( oh) . . . Yo estoy 




la cabeza. 


cansado. Tiene una pena de...(ah) 






...cabello. 




B: 


Esta cansado y tengo un dolor de 






cabeza. 




C: 


Muy cansado y dolor de cahelz]a. 
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V: iPor qurf, hombre? 

R: Acabo de volver de un largo viaje. A: Acabo de volver deade una viaje 

largo. 

B: Acabo de llegar de un largo viaje. 

C: Vol/... Vol/... 



V: Dated debe deacanaar por (ilgunos 

d£aa. 

R: Me guataria irnucho, pero tengo que 

volver al trabajo maSana. 



V ^Sigue uated todavia en el banco? 
R: Hace trea aHos que dejd eae 

pueato. 



V: iQue hace uated ahora? 

R: Ahora estoy enaelRando ingles, y 

me guata mucho mas esta clase de 
trabajo. 

V: Muy bien. A propdsito, ^sabe 

uated que ya tengo dos ni^oa? 

R: Le felicito. ^Cuantos afiios 

tienen? 



V: La chica tiene doa afiiOB,, y el 

nene aeis meaes. 

R: ^Quiere uated almoraar conmigo? 



A: Quiero que podre, pero debe eatar 

...estare de vuelta manana. 

B: (No se.) 

C: Quiere que pued/. . . puedo, pero« . . 



A: Trea ... Mace trea afios que sa'H de 

aquel posicidn. 

B: (Oh, I quit right now!) 

C: He aalido. . . 



A: Ahora enseHo ingles, y me guata 

esta trabajo much mejor. 

B* .... 

C: Ahora estoy el ingles, y. . . 



A: iCuantos aHos tiene? 

B: tCuantos aKoa tiene? 

C: Congrachula [a]idn. tTiene... 



A: 6 AcompaHeme al comedor? 
B: 6'(}uiere uated va... 

C: L Vino. . . 
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V: Como no? Con mucho gusto. 

iA donde iremos? 

R: Conoco o un restaursnte en donde A: 

sirven comidas est'.pendas. 

B: 

C: 

V: Pues muy bien. Vamos. 

R: Tengo un coche abajo. A: 

B: 

C: 

V: tHace mucho tiempo que tiene usted 
coche? 

R: Aprendi a conducir el aSio pasado, A: 

pero este coche es de mi padre. 

B: 

C: 

V: iSu pvidre vive todavfa en el 
campo? 

R: No. El y mi madre se quedan en la A: 

ciudad hasta el verano proximo. 

B: 

C: 



V: 


Recuerdo que sus padres tenfan 






una casa muy hermosa. 




R: 


Desgraciadamente quieren 


A: 




vender la. 





B: 

C: 



i 

'I 

I 

'i 

Conozco uno cafe que sirve f 

comidas muy buenas. | 

Se un restaurante que sirven las ! 
comidas buenas. 

Conoce un cafe que sirve comedor 
muy bien. 

\ 

I 

Tiene un automovil debajo. | 

( j Tengo! ) J 

Tengo un automovil arrib ... I 

abajo. i 

Tengo un coche escaldas abajo. | 

I 

I 

Aprendi a manejar el ano pasado. | 
pero esta automovil pertenecer. . . | 

pertenece al mi pfdre. |{ 

Esta automovil esta el de mi padre. ! 

Canduzco el afio pasado, pero | 

este coche ... { 

I 

i 

t 

Mi padre y mi madre astdn quedando 
en la ciudad hacia la . . . | 

Mis padres viven en la ciudad j, 
hasta el verano que viene. | 

Mi madre y vo . . . I 



Quieren que ven . . .vende . . . 1 o 
vende . 

Quieren que... que la venden. 
Quieren vender el coche. 



ERIC 
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V: Bueno 9 ya estamos. 

R: ^Quiere usted que pida algun vino 
bianco? 



A; 6 Debo le man/., 
vino bianco? 

B: . • • • 

C: ^Queria que. . . 
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de mandar algun 



V: 



R: 



Sif muchas gracias.^ Bueno, ha 
sido un almuerzo estupendo. 
tQuiere usted ir al cine ahora? 
Gracias, no puedo. Quiero volver 
temprano a casa. 



V: Ah, 681 ? iPor que? 

R: Estoy esperando un telegrama 

impor tante esta tarde 



,A; No, gracias. Quiero qvie vol /er a 
casa temprano. 

B: No, gracias. Tengo estoy en casa 

muy temprano. 

C: No, gra[s]ias. Quiero a casa 

temprano. 



A; Espero una telegrame impor tante 
esta tarde. 

B; Espero un telegrama importante 
esta tarde. 

C: Espero una te legram muy importante . 



Sample of German Oral Production. 

The German students were completing an accelerated second-year 
college course at the rate of fourteen hours per week through one 
summer (^946), Considerable attention was paid in this course tos the 
development of oral and aural skills. The responses were transcribed 
by a person present, without any attempt to reproduce faulty pro- 
nunciation or hesitations. Scores by items were not made available to 
us. Ihe three students are designated respectively as A, B, and C. 



PART I 

Picture Series: 40 points 

A's score: 12 
B’ s score: 23 
C’ s score: 20 



O 
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Standard Response 
1. Die Frau strickt einen Strumpf. 



2. Der Jager lauft vor dem Lowen 
davon . 



3. Der Skilaufer macht eiuen Sprung. 



4.- Der Poliziat regelt den Verkehr. 



Actual Response 
A: Eine Frau. . . 

B: Eine Frau macht einen Socke. 

C: Die Dame macht... 

A; Ein grosser Tier fallt nach einem 
Mann . 

B: Der Lowe will den Mann essen. 

C: Der Lowe verfolgt den Mann. 

A* ... 

B: Der Mann lauft unit Ski. 

C: Der Mann macht Ski lauft. 

A: Der Schutzmann ampelt das Verkehr. 
B: Der Verkehrschutzmann regelt der 
Verkehr . 

C: Der Poli'zeimann halt die Auto. 



5. Der Fleischer wiegt das Fleisch ah. A: Da ist ein Mann, der Fleisch 

verkauft. 

B: Der Mann wascht den Fleisch. 

C: Der Mann... Der Fleischer... 



6. Das Madchen winkt dem Schiff nach. 



7. Der Bauer pflugt sein Feld. 



8* Das Dienstmadchen klopft den 
Teppich aus. 



A: Ein Madchen grusst in Dan^fer. 

B: Die Frau sagt auf Wiedersehen zu 
dem Schiff. 

C: Die Dame sagt auf Wiedersehen. 

A: Ein Bauer arbeitet in der Feld. 

B: Der Mann arbeit in dem Feld. 

C: Der Bauer arbeitet im Feld. 

A; Sie schlagt den Teppich. 

B: Die Frau schlagt den Teppich. 

C: Das Dienstmadchen schlagt die 
Wolle. 
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9< ll^r Kellner weist der Frau einen A: Eine Frau geht ina Hotel, und der 



Plata an . 



10. Er gieaat ihr Waaaer ein. 






II. Er aeigt ihr die Sjpeiaekarte. 



12. Er notiert die Beatellung. 



13. Der Riiuber macht einer Uberfall. 



14. Er nimmt dem Mann aein Uhr weg. 



IS. Der Poliaist achlagt den Riiuber 
auf den Kopf. 



16. Der Verbrecher iat im Gefangnia. 



Kellner gibt ihr einen Plata. 

B: Der Ober geben die Frau einen 
Plata . 

C: Der Ober aieht die Dame... der Dame 
einen Stuhl. 

A: Er gieaat Waaaer ina Glaa. 

B; Der Ober achenkt den Waaaer ein. 

C: Er gieaat flieaaendea Waaaer in 
einem Glaa. 

A: Die Dame aieht daa Menu. 

B: Der Ober gibt die Frau eine 
Spe iaekarte . 

C: Er gibt ihr die Speiaekarte. 

A: Sie gibt dem Kellner, waa aie 
eaaen will. 

B: Die Frau beatellen, waa aie lu 
ekaen wiinacht. 

C: Er nimmt ihren Berichte. 

A: Ein Mann iat von einem Dieb. . . 

B: Man aieht einen Mann attacken. 

C: Ein Dieb halt einen Mann auf. 

A: Er nimmt eine Taachenuhr aua. 

B: Er ninimt aeine Uhr. 

C: Er uimmt aeine Uhr. 

A: Und dann kommt der Schutamann und 
achlagt den Dieb. 

B: Der Schutamann achlagt den Kerl 
auf den Kopf. 

C: Ein Schupo achlagt auf den Kopf. 

A: Da iat er verachloaaen. 

B: Der Kerl iat gehalt. 

C: Der Dieb geht ina... 
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17. Zwei Autos sind ineinander 
gefahren. 



18, Der Verungltickte wird suf der 
Tragbahre davongetragen. 



19. Er wird in den Krankenwagen 
gelegt. 



20. Die kaput ten Autos werJen 
abgeschleppt. 



A: Wir haben bier ein Unfall, swei 
Autos kommen susammen. 

B: Zwei Autoa haben einen Zusam- 
menachl uaa . 

C: Zwei Autoa fahren gegeneinander. 

A: Ein Mann ist verletst und man ruft 
der Krankenauto. 

B: Zwei Manner tragen einen Mann auf 
einen Krankentriiger . 

C: Die Krankentrager tragen einen 
Mann aum Krankenwagen. 

A: Der Mann. . . 

B: Sie atellen den Mann in den 
Krankenwagen . 

C: Sie atecken in den Krankenwagen. 

A: Dann koirnit der Laatauto. 

B: Zwei Lastautoa aie ziehen die Autos 
von der Zusanmenschloss. 

C. Zwei Lastautos nehmen die beide 
Auto her. 



PART I 

Sustained Speech: 8 pointa 

A’ s score: 5 
B’s score: 5 
Cs score: 5 

Stimulu$ : ?You have found a sympathetic listener and are about to launch 
upon the story of your life. Start as early in your life as you wish and go 
on until the examiner atopa you. " 

A: "Ea ist nicht in Ordnung von mich zu sagen. Ich war in 1927 geboren. Ich 
wohne in einep Ort mit... und ich habe eine grosae Familie, und ich babe funf 
Schweatern und swei Briider, und bin [place-name] aeit zwei Jahr, und ich 
hoffe einen Tag ein Chemikin zu werden. Die Sommer habe ich sehr gern. Ich 
arbeite in einem Labors t or ium. Viele Menschen glaubt, dass ein Madchen kann 
nicht... solte Chemie nicht studieren. Aber ich. . .es interessiert mich viel. " 
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B: ”lch bin 1923 geboren in [place-name] • Ich babe dort gelebt, und ich bin 
dort jetit lebend. Meine Mutter war dort verheiratet. Mein Vater hat eine 
Fabriki wo er artificial Leder macht« Wir h^ben ein Haunt in wo wir im 
Soawer wohnen. Ich bin 1945 nach [place-name] gekommen, und ich habe hier ' 
1943 geblieben. 1943 bin ich ina Armee gegangen. In daa Armee ich war amI 
Luftwaffe, v''d dort war ich ein Off icier der Gunnery# In 1945 bin ich in den 
Pacific gegangeu# Dort bin ich uber Japan gefliegen# Im Juni 1945 wir haben 
einen ZuBammenachloea gehabt, und einen Monat dahinter habe ich nach Amerika 
in einen Krankenairplane geflogen. ” 

Stimulus: "You have met a young German in Europe who aeema to you to have the 
nakings of an outatanding American citiien# You reaolve to try to convince 
him that he ahould emigrate to the United Staten# Talk to him about the 
United Staten, no that you may help hin to decide whether he would like to 
come# " 



C: "Sie aind wie ein guter Mann aua# Sie wollten einen guten amerikaniachen 
Mann aein# In Amerika haben wir viel Freiheit# Wir kdnnen viel tun daa Sie 
in Deutachland konnen nicht# Der Preaident iat bei die Leute choaen und da 
er iat fur vier Jahre der FShrer# Man muaa nicht#.###" 

PART II 

Converaation: 90 pointa 

A't acore: 52 
B’ a acore : 47 
C’a acore: 49 

V ~ Voice on record 
R ~ Standard Response 

R: Haben Sie fur dieaea Wochende 
etwaa vor? 

V: Nein, ich habe mir garnichta 
vorgenonnen # 

R: Wie ware ea, wenn Sie und Ihre 
Frau einen Auaflug mit una 
luaaflnaeniwc hen? 



Actual Response 

A: Geht ea uber die Wochenends? 

B: ##,# 

C: Waa wollen Sie Wochenende inachen? 



A: Warum gehen Sie und Ihre Frau...# 
B: Warum kommen Sie mit Ihre Frau 

lU. # # 

C: Komnen Sie doch mit mir auf ein 
Picnic# 
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V: D«a iat eine ausgezeichnete Idee, 
Was haben Sie vor? 

R: Meine Frau hat an eine Autofahrt 
aufa Land gedacht. 



R: Ich weiaa einen abgelegen See oben 
in den Bergen. 



R: Mir gefallt es dort weil ea schon 
kiihl und angenehm iat. 



V: Daa paaat mir gut. In welchem Auto 
wollen wir fahren? 

R: Mein Auto iat grbsaer ala Ihra. 



R: Kbnnen Sie Ihren kleinen Neffen 
mitbringen? Dann hat meine 
Tochter jemand zum Spielen. 



A: Meine Frau aagt, daaa wir ins 
Aualand mit ihrem Auto gehen. 

B: Meine Wife will ina Land in daa 
Auto fahren. 

C: Meine Frau will zum Land mit Auto 
fahren. 

A: Ich kenne einen sehr achbnen See 
hoch in Bergen. 

B: Ich kennen ein See hoch in den 
Bergen. 

C: Ich kenne ein herrlicher See in 
den Bergen. 

A: Das gefallt mir weil es so kiihl 
und schon ist. 

B; Ich habe das gern, weil er sehr 
kiihl und ist bequem. 

C: Es gefallt mir, weil es kiihl und 
angenehm ist. 



A: Aber mein Auto ist grosser als 
Ihrer ist. 

B; Mein Auto ist grosser als Ihres. 

C: Mein Auto ist grosser als Ihrs. 

A: Warum bringen Sie nicht seinen 
kleinen Neffen mit, und ich will 
bringen meine Tochter. 

B: Kbnnen Sie eine Neffe mitbringen, 
und meine Tochter v:ird... 

C: Kbnnen Sie Ihren Neffe bringen; 
meine Tochter will mit ihm spielen. 
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V: Naturlich, wenn seine Mutter 

nichts dagegen hat. Ich werde sie 
heute Abend fragen. Wir sorgen 
naturlich furs Essen. 

R: Wenn Sie das Ess^n mitbr ingen, dann 
rniissen Sie mich fiirs Benz in 
bezahlen lessen. 



R: Sie rniissen mir versprechen, dass 
sich Ihre Frau nicht zu viel 
Umstande dabei macht. 



V: Wann wollen wir uns dann treffen? 
R: Sonnabend friih punkt sieben Uhr, 
wenn dass nicht zu friih ist. 



V: 0 nein, es ist garnicht zu friih. 

Und Wo wollen wir uns treffen? 

R: Ich werde Sie bei Ihnen zu Hause 
abholen. 



A; Wenn Sie das Essen br ingen, dann 
muss ich die Benzin bezahlen. 

B; Wenn Sie das Essen br ingen, rniissen 
Sie mich urn das Benzin zahlen 
diirfen. 

C; Wenn Sie das Essen br ingen, dann 
muss ich fiir Benzin zahlen. 



A: Aber Sie rniissen mir versprechen, 
dass Ihre Frau. . . 

B; Versprechen Sie mich, dass Ihre 
Fi‘ 6U nicht zu viel... 

C; Ihre Frau mussen nicht zu schwer 
arbeiten. 



A: Wenn es r ' iht zu friih fiir Ihnen 
gehen Sonnabend morgen... 

B; Sonnabend friih urn sieben Uhr, weil 
das ist nicht zu friih ist. 

C; Samstag Morgen urn sieben Uhr, wenn 
das nicht zu friih ist. 



A; Ich will Sie... Ich will Ihnen zu 
Hause . . . 

B; Ich treffe mit Ihnen urn ... bei 
Ihnen . . . 

C; Ich will Ihren ... zu Ihrem Mouse. 
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V; Dbi pasat mir auagezeichnet. 0, 
bevor ich ea vergeaae, ein Freund 
von mir hat mir zwei Karten fur die 
Oper heute abend geachenkt. Meine 
Frau und ich kbnnen leider nicht 
gehen. M'dchten Sie aie gerne 
haben? 

R: Daa iat furchtbar nett von Ihnen. 
Welche Oper wird gegeben? 



A: Das iat sehr nett von Ihnen. 

Welche Opern gibt es? 

B: Dankesehr. Welche Oper gegeben ist? 
C: Das ist sehr nett von Ihnen. 
Welche Oper spielt? 



V: Die Me is ters inger von ffurnberg. 
R: Ich kann diese Oper inaner wieder 
hbren . 



A: Das Oper kann ich iiber und iiber 
horen. 

B: Ich kann jede Oper immer hbren. 
C: Ich kbnnte das wieder und wieder 
hbren. 



V: Das freut mich sehr. Hoffentlich 
gefallt Ihnen die Vors tel lung. 

R: Ich muss mich Jetzt beeilen, sonst 
verpaase ich meinen Zug. 



A: Ich muss eilen, oder ich will 
meinen Zug '/erlassen. 

B: Ich muss mich eilen, oder meine 
Zug verpassen werde. 

C: Ich musse eilig gehen denn ich 
mein Zug nicht . . . 



V: Na, dann will ich Sie nicht lilnger 
aufhalten. 

Rj Grussen Sie Ihre Frau von mir, und At Grussen Sie meine Frau fiir mich, 
rufen Sie mich dpch morgen nach und rufen Sie mich morgen Nacht. 

dem Abendessen an^ fi; Griiss Ihre Frau, und reden Sie 

mich nach das Abendessen. 

C: Rufen Sie mir morgen an. 



O 
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Evaluation of Oral Performance 

We pointed put at the beginning of this section on oral pro- 
duction that our test results are based on small samples, that 
those samples are unrepresentative in that they are unduly 
loaded with advanced students and with top performers, and that 
the rating of achievement by teachers themselves was unavoid- 
ably subjective. Even though the resulting figures must be 
regarded as high by comparison with what would have been 
obtained from a more representative group rated more objec- 
tively, these existing figures are low in terms of total 
possible achievement. They range from 30% to 64% at the lower 
level and from 46% to 59% at the upper (exclusive of the 
unreliably rated Part H) . They thus give clear enough evidence 
that the American student of a second language shows no highly 
developed ability to speak that language when confronted with 
a test designed to measure that ability within a vocabulary 
range not exceeding 3,000 words. This is of course to be 
expected in the case of students not specifically trained in 
oral production. The oral tests, however, produced no notably 
different results with the handful of students in experimental 
courses giving specific oral training. Such students can 
iBidoubtedly outtalk the conventional student in such situations 
(real or simulated) as form the basis of his particular text- 
book “ he can go to the theater, or lay in supplies, or play 
games in the language if his book does, because he has learned 
the specific words, and sequences of words, to use in the 
given situation. But take him out of his special situation — 
ask him, for example, to chat with a friend on some other 
topic, or to make small- talk — - and he is only too likely to be 
tongue-tied. If he knew the words and patterns to use he 
would doubtless pronounce them more authentically than the 
conventional student, for he has learned to articulate through 
direct imitation of a native speaker. But his vocabulary has 
enormous gaps, and what is more he has not yet developed a 
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flexibility in handling and varying the structural patterns q£ 
the language. Tlius he is comparatively innobilized when con- 
fronted with the unfamiliar test situation. And those who would 
claim for this student an approximation to native speech must 
surely 'realize that on these same oral tests a native speaker 
would (provided he knew enough about Engl;ish to follow the 
directions for responding in Part M), automatically make a 
perfect score. 



SUMMARY 

In the present chapter cn the Investigation’s Aural and Oral 
Testing Program we have described our apparatus for standard- 
izing the aural comprehension tests, have presented the norms 
which resulted, and on the basis of those norms have attempted 
certain comparisons between different college and hig^-school 
groups in each language, as well as a few comparisons (subject 
to reservations) between similar groups in different languages. 
We have discussed the problems involved in the administration 
and rating of the oral production tests, and pointed out the 
impossibility of standardization under the circumstances which 
prevailed. 

Oi the basis of the results obtained in the two series of 
tests we conclude that neither the conventionally taught nor 
the specially trained students were able to understand or to 
speak the language with near°native competence after studying 
it up to three years. Further, the student in an experimental 
course emphasizing the development of aural-oral skills demon- 
strates no greater proficiency than the untrained student 
probably because f 1) while he admittedly has good comprehension 
of native speakers and authentic production within limits, 
those limits are narrow, determined by the topically special- 
ized materials he studies; (2) he has not developed skill in 
quickly comprehending sustained se^ents of speech heard for 
the- first time or in easily producing variations of the struc- 
tural patterns he has learned. 



Chapter V 

Comventioiial Groups Not Siressieg 
Aural -Oral Objectives 

The norms presented in the preceding chapter constitute one 
scale for measuring the work of the experimental groups, for 
those tables give a fairly representative portrayal of the 
general level of students’ aural comprehension as it is 
defined and measured by our tests. That standard is valuable 
as far as it goes, but still more exact comparisons are 
possible if comprehensive testing results from experimental 
programs can be m.atched with equally detailed measurement of 
conventionally taught groups. Seven colleges and one high 
school did this rather extensive testing for us, administering 
both the reading and aural tests to classes not taught by any 
experimental method. 1 In addition, many of them supplied 
supplementary data about the students (intelligence scores, 
high-school records, college marks, etc.) parallel to those 
furnished us by most of the experimental programs. Some of 
these institutions were also offering experimental courses; 
but in their case these intramural comparisons are neither so 
exact nor so revealing as might be expected. Consequently we 
sought information from other schools as well. Though these 
conventional groups are mostly at other institutions than the 

iThe ci&rrent interest in the sursl-orsl skills and in intensive instruct 
tion may have led some of these institutions to psy somewhat more attention 
to these abilities snd to increase slightly the number of weekly clsss hours 
to four or five; but no acoustical laboi^ator ies have been installed, no 
native speakers imported, and no new textbooks adopted. 
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experimcnital ones, they are at somewhat similar schools — 
insofar as the diversity of American edncaticMial institutions 
makes for even general similarity. They thus permit good, 
though not perfect, comparison. 

Furthermore, the study of these conventional classes, quite 
apart from its value in assessing the work of the experimental 
courses, is significant in its own right as a picture of 
current language teaching in this country, its procedures 
and achievements. 

College 

A professor of Spanish at College A (a small liberal arts 
college) used the Investigation's aural tests in May, 1946. 
This experience led him to ccmnnient to us with such interest 
and penetration on the basic problems of second- language 
teaching that we' asked him to arrange a full testing program, 
covering three languages, at College A for the academic year 
1946“1947. Through our colleague's untirr'ng collaboration and 
meticulous care for details, these plans were executed with 
more than usual efficiency. We present the resulting data as 
fairly typical of second- language teaching in small liberal- 
arts colleges at the present moment. 



^Instead of naning the Ysrioms centers, we shsll designate 1;hein as 
College A, College B, High School A, etc. Our aim is not primarily tv> 
disguise the identity of the various institutions; resders familiar with 
current developments in the field will probably recognise most of them, for 
all other relevant information is reported sccurstely and in detail. Esther 
we have in mind two purposes. One is s matter of relative emphasis: in an 
objective investigation, the identity of a given institution is not s 
relevant factor in evaluation; and we hope that anonymity will keep the 
reader continually aware of the most important factor, namely the relation 
between procedures and outcomes in a program, regardless of where it may be 
or who may b% directing it. Secondly, we wish to avoid all implications .f 
advertising on the part of the institutions involved, and of either praise 
or censure (as the case may be) on our part. In any event, from the point of 
view of language teaching in general, the important result is not the 
success or failure of a particular program at a particular institution but 
the general knowledge of principles and procedures which can be drawn from 
these undertakings. 
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Spanish 

Our collaborator at College A describes the first and 
second- year Spanish courses as follows: 

You probably noticed that our students gave a wide range of 
performance on your tests. ^ I think it is at least partly due to 
the fact that we try to carry students of a wide range of ability, 
with a method sufficiently eclectic for them to progress most in the 
skills most suited to them. 

Ihese students were the first ones to go through a whole year of 
a system which we have been developing to give a considerable amount 
of oral work without sacrificing much, if any, of the other aims. 
It is quite simple, and it may be that no part of it is new, but I 
haven’t found its elements elsewhere. It consists of questions 
asked about whatever text material we are using, whether the Spanish 
section of a grammar lesson or a section of a reader. These 
questions break the sentences of the text into smaller units, and 
can be answered directly from the text, in some cases requiring a 
shift of person in the verb or a possessive adjective, in other 
cases requiring no shift at all. We prepared mimeographed sheets 
for Keniston’s Learning Spanish; some of the lessons will be revamped 
before fall to give more practice answering in the first person. 
Because the answers can be taken so easily from the text, the 
students soon get so they almost always give the answer correctly. 
TRiis means that they art writing and saying correct Spanish, and not 
forming bad habits. We use the questions and answers in two wayt.: 

( 1 ) as ordinary question-and-answer material, the instructor asking 
the questions and the students answering singly or in chorus, and 

(2) the answers alone as composition material, the instructor giving 
the English and the students then giving the Spanish, orally or in 
writing. Sometimes the students are paired for a question-and- 
answer period. 

There is something about this use of questions which makes the 
learning easier than outright memorization. Perhaps it seems natural 
to the mind to give an answer to a question. Since the questions 
break the reading sentences into shorter units, the students learn 
to read material which is rather difficult syntactically, but have 
less difficult material to put back into Spanish. The better ones 



^The first tdministration of tha aurals at the college, in May, 1946. 
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learn to string the short sentences into 1 onger ones, while the 
poorer students still have material which is within their ability. 

Ihe first book we use is Keniston’s Learning Spanish, for three 
reasons: (1) the constructions are presented in order of frequency, 
so the students get most practice on the most common ones; (2) the 
material in the reading section of the lessons is interesting, and 
the book teaches them to translate well from Spanish to English or, 
if you prefer, to read and understand Spanish well. Starting at the 
first of the past school year, we used the question system through- 
out the book. Ihe second book we used was A Mexico por automovil , 
and questions were used throughout. Die third book was Noche Oscura 
en Lima, with questions used only in the first fifteen lessons; 
after that we read rapidly to finish the book before the end of the 
year. 

We do considerable chorus work in our classes -=• reading aloud, 
answering questions, translating English to Spanish «- because in 
that way each individual gets more practice. An inexperienced 
instructor can follow the questions closely and give his students a 
lot of oral work; an experienced instructor will begin with the 
questions as given and gradually work his students into freer 
questioning and answering, sometimes on a level that might be called 
conversati(m. 

The second year classes had had some of the question method in 
their first year (the last twelve lessons of Learning Spanish, twelve 
lessons of A Mexico por automovil, and fifteen lessons of Noche 
Oscura en Lima) , except for those who entered the course after two 
years of high-school Spanish. In ^ their second year we put them 
through House and Mapes* Shorter Spanish Grammar to start with. We 
find that a beginning grammar is better than a review grammar for 
co-ordinating our own students and those coming from high school. Of 
course we go through it more rapidly than we would if we were using 
It with beginning students. After the grammar was well started, we 
began reading Cano and Saenz* Easy Spanish Plays, Enough of the 
plays were staged in the classroom to give each student a chance to 
memorize and perform one long p\irt or two or more small parts. Next 
they read El D iablo Blanco Mkid most of 01mstead*s edition of 
Becquer*s Legends, Tales and Poems, Running concurrently with the 
readers and with each other were Berkowitz*s Temas de Repaso and 
Madrigal and Madrigal*s Invitation to Spanish, This last book was 
used in an attempt to maintain what oral proficiency they had 
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previoualy acquired, with material so simple that it would not take 
much time either for study or in class. We wanted the oral work 
without taking much time from the re lading. I do not feel that it 
was very successful. 

In 1946-1947, three Spanish groups participated in the 
testing program; (1) eighty- four first -year students, (2) 
fifty”eight intermediate (second-year) students, (3) sixteen 
advanced students. 

Group 1. The first-year course met five hours per week for an 
approximate total of 150 class hours. The students were tested 
both visually and aurally at the end of the first semester 
(January), and again at the end of the year (May). The results 
in mean scores were as follows: 



CO-OPERATIVE 



JAN. (75 HRS.) MAY (150 HRS.) 





ADV. 


p 


ADV. 0 




MEAN 


(«ILE)# 


MEAN 


(«ILE)# 


R* 


43.4 


(13) 


60.9 


(77) 


V 


43.7 


(11) 


59.4 


(64) 


G 


45.6 


(25) 


54.6 


(61) 


T 


43.8 


(13) 


59.2 


(68) 



AURAL 



JAN 


. (75 HRS.) 


MAY (150 


HRS. ) 




LOWER B 


LOWER 


A 




MEAN 


MEAN 


(TENTH) 


I 


3.5 


4.0 


(4) 


1 


4.7 


8.8 


(4) 


II 


7.8 


14.0 


(6) 


T 


16.1 


26.7 


(4) 



*B = Reading; V = Vocabulary; G = Grawmar; T-= Total 



^Theae percentilaa are drawn fron The Co-operat ive Achievement Teetej A 
Booklet of Norme, publiahed by the Co-operatire Teat Service of the American 
Council on Education, New York City, May 1938. The preaent figurea are 
found on pp. 68-71: End-of-year percentile norma in terma of Scaled Scorea 
for College Studenta who have had no inatruction in Spaniah in aecondary 
achool: Type II (typio«l liberal-arta) collegea. — In all aubaequent 
reporting of norm percentilea for the C^-operative teata, we^refer to^the 
appropriate yeara-of-atudy coluain of the Type II norma aa aet forth in thia 
booklet. 



^Theae tentha are drawn from the decile norma aa aet forth for the Aural 
Teata in Chapter IV, pp. 65-70. The figurea for the May teating are taken 
from Spaniah Norm-group IB; figurea are not available for the January 
teating, aince Norm-group lA (leaa than 90 houra) waa not conatituted for 
Form B. 



122 



AN INVESTIGATION OF SECOND -LANGUAGE TEACHING 



Evidently fhe reading-objective was not unduly sacrificed 
for the sake of aural training with this group, who from 
January to May advanced 15.4 scaled-score points in the total 
Co-operative score to reach the 68th percentile, and was by 
then strongest in Reading. (They progressed least in Grammar, 
on which part they were lowest in May. ) While they advanced 
substantially also on the aural test (especially on the 
anecdotes), they remained slightly below the median in this 
field. 

Group 2. The second-year group was composed of thirty- five 
students who had completed one year of Spanish in the college 
(whom we shall call Subgroup 2.1); and of twenty- three 
students, all but four of theni entering freshmen who had 
begun their study of the language in secondary school (desig- 
nated as Subgroup 2.2). The course met four hours per week for 
a total of 120 hours. The full group was tested at the 
beginning (October) and at the end (May) of the year. The 
results were as follows: 
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*For the enterinf Freahnen. thia figure naturally varied with the amount 
of hifh-achool atudy. 



This group, which began and ended lowest on the Vocabulary 
Section of the Co-operative, was not as high (60th percentile) 
at the beginning of the second year as the elementary group 
was at the end of the first (68th percentile). It was the 
members who began Spanish in the college (Subgroup 2.1), 
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however, who pulled the total mean down; the entering freshmen 
had a total mean of 57.9, while that of Subgroup 2.1 was 
55.6 (this difference, however, did not prove to be signi- 
ficant). By the end pf the 270 hours the full group, still 
relatively weakonVocaljuiary, had attained the 53rd percentile 
of the two-year Co-operative norms. At this time Subgroup 2.1 
had a Total mean of 64.6, while those who had entered the 
course from high school scored 70.0, showing a difference of 
5.4 points, significant at the 1% level (i.e., with only one 
chance in a hundred that the difference was due ta error in 
sampling). 

Since usually such a significant difference is mere likely 
to appear at the beginning of the year and to level out as 
all members of the clsss are subjected to identical instruction, 
we are led to inquire if other differences between the two 
subgroups existed to account for this one. A comparison of 
L-scores on the American Council Psychological Examination 
(taken at entrance) shows a mean difference in favor of the 
high-school subgroup of 5.8, which, however, does not prove 
to be significant. At the same time a comparison of cumulative 
grade -point averages for the second semester shows a mean 
difference in favor of the other (college) subgroup of .08, 
and this, again, is non -significant . In the absence of 
significant differences in intelligence and in general college 
achievement between the two subgroups, one person’s guess is 
as good as another’s as to why the significant difference 
appears in the Co-operative results. It can be that the 
high-school subgroup, whose performance at the beginning of 
the year was not significantly better, nevertheless did 
possess a solider grounding and was the better able to profit 
from the year’s instruction. Or it can be that the high-school 
group, most of whom were freshmen, worked harder in their 
first year of college Spanish than the others, most of whom 
were sophomores, worked in their second year. Or it may be 
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that neither of these factors, but another or others which 
escape our search, account for the difference. 

On the first aural test, t!,!ie subgroup entering from high 
school also scored higher (total 32.5) than the college 
subgroup (total 30.2), but the difference was not significant. 
At the end of the year, the high-school subgroup totaled 42.9 
on the aural test as against 39.4 for the college-trained 
students. Again the difference was non-significant; it is 
noteworthy, however, that the latter subgroup scored lower 
despite the fact that twenty-one out of its thirty-five 
members had already taken the same form of the lower -level 
aural test one year previously. ^ 

These twenty-one compiled a total mean of 45.7 as against 
30.9 for the balance of the subgroup. Some of them doubtless 
recalled certain items (particularly one or another of the 
anecdotes retold to them by fellow students after the testing), 
and thus their scores on the 1947 repetition must be recognized 
as raising the mean score of the subgroup through an extraneous 
factor; had it not been for this factor, the aural mean for 
Subgroup 2.1 might have been significantly lower than that of 
the' high-school group, as was the case with the Co-operative 
test. 

Group 3. These were members of a course in Spanish Phonetics 
and Conversation, described in the college catalogue as 
"A scientific study of pronunciation and oral expression. 
Intensive drill in pronunciation with individual use of the 
phonograph for corrective purposes. The second semester is 
devoted primarily to conversation and oral reports." Classes 
were held two hours per week, for a total of 30 hours in the 
year. Sixteen students were tested in January, and the seven 
of them who continued through the second semester were tested 
again in May. The results follow: 

^Their mean scores on thst testing: I, 7.2; IIo 12.9; III, 13.1: Total, 
33.1 (7th tenth, Norm*grou]p IB). 
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Already in January this group stood at the 55th percentile 
of the three-year Co-operative norm — which was to be expected 
of rvelf-selected students taking advanced Spanish because of 
previous success in, and liking for, language -study. It is 
curious, however, that the seven finishers were less successful 
at mid-year than those who discontinued: their Total Co-opera- 
tive score was only 73.0 (47th percentile). Thereafter, while 
increasing their Vocabulary scores considerably, they fe 11 
off in Beading and Grammar, a situation probably explained by 
the fact that their second semester was devoted chiefly to 
oral work and did not continue to exercise those reading 
skills. 

In January the total aural mean of the seven continuing 
students (42.9) was lower by a decile than that of the full 
group (49.5) and thus the final mean of 50.6 indicates 
improvement .during the second semester. In noting the decile 
ranking on these tests, however, one should remember that 
these students had accumulated many more class hours than 
most students on whose scores the norms are based. 

French 

Two French groups were followed through 1946=1947 at 
College A: (1) fifty-one regular first-year students, and 
(2) sixteen students taking an accelerated elementary- 
intermediate course. The two courses are described in the 
college catalogue as follows: 

(1) Elementary French.' ■— An introduction to spoken French and 
elementary French reading. Pronunciation, oral work, essentials of 
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grammar, and the reading of easy materials dealing with the civili- 
sation and contemporary affairs of France. Students wishing to 
develop aii ability to understand and speak elementary material spend 
at least a half hour each day in laboratory work with phonograph 
records, with locally made transcriptions of lesson materials and in 
conversational practice with a French-speaking assistant. 

(2) Elementary Speaking and Intermediate Rending. — A concentrated 
course for beginners of approved aptitude, designed to develop a 
basis for oral facility and a reading ability in two semesters. 

Group la. This regular eiemeintary group met five hours per 
week for a total of 75 hours each semester, exclusive of the 
optional laboratory hours. The testing procedure was the same 
for the French beginners as for the Spanish, i.e., Co-operative 
and aural at the end of each semester. The results: 
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From January to May the group advanced 9.1 points in the 
Total Co-operative score to reach the 67th percentile, and was 
strongest in Grammar. By comparison with Spanish Group 1, 
these French beginners were more advanced in the reading 
skills at mid-year but were at the same level at the end of 
the year. In aural ability, however, the group placed in the 
7th tenth at the May testing as compared with the Spanish 
group in the 4th. Differences in intelligence and general 
college achievement between the French and Spanish beginning 
groups favor the French®; but it is doubtful if these 
differences account *for the higher aural performance so long 

Slhe ACE L'^scores averAge 74.6 and 67.9; the grade-point averages are 
1.65 and 1.37t respectively. 
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as the correspondinig Co-operative scores are no higher, since 
both tests yield about the same correlation with intelligence. 

This elementary French group also offers the opportunity 
to study the effect of previous experience with the language. 
Thirty-eight who had had no previous experience with French, 
we will call Subgroup la. 1. The other thirteen meifk >ers , although 
enrolled in the elementary course, had already begun to study 
French in high school.® These we will; call -Subgroup la. 2. 
In examining differences between the Co-operative and Aural 
scores of these subgroups, we find that at midyear the 
students with high-school experience made a Co-operative 
Total mean of 57.5 as against 49.9 for the raw beginners; 
on the aural they scored 26*2 as against 19.1. Both these 
differences are significant at the 1% level. It is quite 
possibly the fairly liberal sprinkling of students with 
previous exoerience in this group which accounts for the higher 
I'eading achievement at 75 hours in French than in Spanish, for 
in Spanish only six of the eighty- four beginners had had 
high-school experience. 

At year*s end the subgroup with previous experience (la,2) 
was still ahead on the Co-operative by 64.1 to 59.9 and on 
the aural test by 29.2 to 28.4 but the differences are no 
longer significant. This is the usual situation in which 
elementary students having previous experience with the 
language fail to maintain tiieir advantage over the. raw 
'beginners throughout a year. In practical terms this also 
means that raw beginners are scarcely justified in complaining 
that they arc handicapped in competition with the partially 
initiated members of their group. 

Group lb. Testing of this accelerated elementary- inter- 
mediate group was the same as for Group la with the following 
results: 

60n« had three yeere, four had two yeara, and eifht had one year. Their 
arerage grade for theae yeara waa B, which doea not auggeat that they began 
the language again in college because of earlier failure. 
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mediate reading" ability in two semesters, the Co-operative 
scores do not indicate that this objective was successfully 
attained. In fact it is doubtful that it could be reached in 
a total of mly 30 more hours of class instruction than the 
elementary group received. At midyear the group stood only at 
the 19th percentile, of the cne-year norms in the Co-operative, 
and reached that level chiefly on the strength of their 
showing in Grammar. At the end of the year their reading 
skills had improved 15.2 points to reach the 28th percentile 
of the two-year norms. Incidentally, although they managed 
to surpass the regular elementary group at the end of the 
year, at midyear they scored lower on all parts of the Co- 
operative test, even though they had had 15 more hours of 
instruction. This might conceivably be due to a proportionally 
greater emphasis on oral-aural work during the first semester, 
with a consequent sacrifice of reading development in early 
stages. However, this difference of emphasis failed to produce 
ccnpensatingly higher aural scores; on the contrary, the group 
scored I'lower on the aural tests than the regular beginners 
both at nddyear and at the end, when they placed only in the 
4th tenth, as contrasted with the 7th for the beginners who 
had 30 less hours. This failure of the more intensive French 
Group lb as contrasted with Group la cannot be explained on 
the basis of such factors as intelligence or application, for 
the differences between the means on the ACE L-’Score and on 
cumulative grade -point average a.re not significant. 
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Russian 

Two small Russian groups — the only ones receiving 
instruction in this language at College A — were also tested: 
(1) twelve elementary students, and (2) a dwindling handful 
of second-year students. The college catalogue announces the 
respective courses as follows: 

1. An introduction to the Russian language with such training in 
grammar as is required for reading a highly inflected language. The 
main purpose of the course is to provide the basis for a reading 
knowledge of current writing (newspapers and non-technical magazines) 
and of current literature, but there will also be practice in using 
the idiom of everyday speech. 

2. A continuation of the study of the Russian language and its 
literature.. 



Group 1. This elementary group was tested only at the end 
of the year’s course, after 150 hours at five per week. The 
reading and aural scores: 
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but the aural scores are median. 

Group 2. Sijc st^udents began a second year of Russian, after 
diverse amounts of elementary instruction in 1945-1946. Only 
•three of them had taken the full 150-hour beginning course, 
completing twenty-two lessons in the Semeonoff grammar and 
making concurrent use of two elementary readers. The other 
three had met with the instructor only one evening a week 
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(not for credit) and had covered much less ground; one of 
these, having begun Russian in Australia scxne years before, 
had not resumed his study at College A until midyear. In 
1946-1947 these six students began as a single "second-year" 
group, meeting four hours per week. Their work was divided 
into three parts: grammar review, conversatioini, and reading, 
about half the time being devoted to the latter. The conversa- 
tion work was handled by a native Russian. 

The six were tested in January. For this small group only 
the total means are reported here: 

INVESTIGATION’S TEST AURAL 

LOWER A 

MEAN (tenth) mean (TENTH) 

T 31.7 ’ (3) T 16.7 (1) ' 

While the score for the reading skills is higher than that 
of the elementary group, the aural score is far lower. Two 
facts account for this discrepancy: (1) these students 
received a very small quantity of ear training in their 
introductory course, and (2) none of them was of Slavic 
family background, as against four such students in Group 1. 

Three of the six continued the Russian course to the end 
of the year and were tested again in May with the same forms 
of the two tests. Their total mean scores were: R-V-G test, 
39.0 (4th tenth); aural, 18.0 (2nd tenth). Their progress 
during the second semester is thus observed to have been 
relatively slight. 

Further Studies 

The mass of supplementary data furnished us by College A 
makes possible, through the use of correlation techniques, 
some further studies which illumine certain aspects of 
language teaching, not only at College A but in general. The 
complete set of coefficients appears as Table IX and is based 
on Spanish Groups 1 and 2 and French Group la. 
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TABLE IX 

College A: Correlations 
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^Language Score on the American Council on Education's Psychological Examination. 

The first issue is the relation between the reading and the 
aural skills. At midyear the correlations between the aural 



l»rm' 



4j- IV, 4»*j4^'-i«4Aafe*f r> 'y ' • yi**fcf«".i • 



132 AN INVESTIGATION OF SECOND -LANGUAGE TEACHING 

tests (B forms) and the Co-operi'.tives (Spanish P and French Q) 
range fran about .60 to .70. These coefficients are slightly 
higher than usual, but it scarcely seems worth while to seek 
an explanation since at bhe end of the year the correlations 
(.44°. 68) between the A°forms of the aurals and Spanish Q 
and French R fall within the usual range. 

An obvious further question in this regard is how much is 
basic intelligence the cbinnon factor which tends to determine 
the scores on both tests. Taking the L-score of the ACE 
Psychological Examination as the measure of this trait and 
holding its influence constant by partial correlation, we find 
that the coefficients are lowered by .01*. 15, but, in the 
main, such relation as exists between the two sets of abilities 
does not depend primarily on their common relation to in- 
telligence. 

The relative emphasis given the different skills at College 
A can b^ clearly seen by examining the correlations between 
the grades assigned at the eixl of the second semester and the 
students’ scores on the two tests at that same time. The 
coefficients between the final grade and the Co-operative 
score are the highest in the entire table, ranging from 
.70-. 75. Even when intelligence (as measured by the ACE 
L-score) is partialed out, this relation remains high (.64-. 73). 
In short. College A, like many other schools which stress 
reading ability, grades students on their ability to read, 
write, and translate, and hence on the skills measured by the 
Co-operative tests, (jn the other hand, aural ability figures 
much less in the final grade, with the coefficients ranging 
from .22 to .51. If intelligence is partialed out, these 
figures drop to the range .04-. 41. Perhaps the most revealing 
of all is the further fact that, if the abilities measured by 
the Co-operative test are partialed out, then the correlations 
between the aural score and the final grade fall still lower, 
two of them being -.23. 



GROUPS NOT STRESSING AURAL-ORAL OBJECTIVES 



133 



Another point illuminated by these figures is the consis- 
tency with which students develop the various skills. This 
evidence lies in the correlations between the two administra- 
tions of each type of test. For both tests these coefficients 
are of about the order .60-.70. This is a fairly high relation; 
but the familiar cases of the student who "doesn’ t find himself 
until late in the year” or who ”tries to live all year off 
his hard work the first few weeks while his good resolutions 
lasted" keep the progress of the class as a whole from being 
uniform in gaining either set of skills. 

Finally, it is worth noting that the measure of verbal 
intelligence is about as good a predictor of elementary 
language grades as it is of other school achievement (as 
indicated by the grade-point average) and that the degree of 
relation (roughly .30-. 40) is typical. 

Since College A is the first institution we have studied 
in detail and since it' presents a typical picture, we have 
commented on these points at some length. Hereafter we shall 
mention only those instances which deviate markedly. 

Summary of College A 

College A is the type of school often considered fairly 
representative of small liberal arts colleges. This typicalness 
is substantiated by the descriptions and data we have just 
presented. The instruction is "conventional" in the sense in 
'which we use the term. The general procedure is that followed 
in many colleges, with, as usual, such modifications as are 
suggested by local conditions or the experience of the staff. 
Attainment in the reading skills is average or better, and 
some superiority is to be expected at an institution where the 
staff is sufficiently interested to offer its work for 
examination . These reading skills receive chief emphasis in 
the course, as is indicated both by the formal statements and 
by the heavy weighting of these abilities in awarding the 
final grades. The level of aural comprehension also runs 
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slightly higher than average and constitutes the most unusuaJ 
feature of the picture. A fairly large number of class hours, 
slightly more than usual emphasis on the aural-oral skills, 
and somewhat less vocabulary trouble for the students vis-a-vis 
the aural tests (as compared with students using some of the 
aural -oral texts) are factors which may account for this 
performance. The relations of the skills to each other, to 
intelligence, and to general college achie'Vement are all 
fairly typical. 

College B 

We arranged a program of collaboration with College B 
(a mediuTii-sized city university) chiefly because its department 
of Romance languages had been operating, since the fall of 
1944, a series of experimental intensive courses at different 
levels in addition to retaining all its conviisntional three- 

II 

hour-per-week courses. We tested both the experimental and 
the regular classes in 1945-1946, and obtain<|id a large body 
of supplementary data concerning many of the students’ 
intelligence, high-school language study, success in college, 
language courses, and the like. Interesting comparisons were 
expected to issue fiom this data, but all thie experimental 
groups proved to be so small that no significant comparisons 
could be made between them and the regular groupik . Furthermore , 
local considerations imposed the testing of bo|h types at the 

same calendar time, instead of at identical amounts of 

1 ' 

accumulate(' contact hours, the only point at which comparisons 
coiild be rr«aningful. Consequently we shall discuss the two 
programs separately, the conventional groups' here, and the 
experimental ones in the ' following chapter. ^ 

Our testing program covered several groups pi conventional 
students at the intermediate and advanced levelp in French and 
at the intermediate level in Spanish. 
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French 

Group 2a. Orie French group was tested toward the end of its 
intermediate course. Many of the students had entered the 
course from high school; the balance, who had begun the study 
of French in the university, had accumulated 90 hours in the 
elementary course and were adding 90 more in the intermediate 
for a total of 180 hours. On that scale the group was tested 



at 145 


hours , 


in October 1945, 


with the 


following results: 




CO-OPERATIVE 






AURAL 






Group 2a (N=50) 








OCT. 1945 (149 HRS.) 




OCT. 


1945 (145 HRS.) 






ADV. R 






UPPER A 






(2 YR. 










MEAN 


KILE) 




MEAN 


( TENTH) 


R 


64.7 


(40) 


I 


6.4 


( 4 ) 


V 


66.9 


(28) 




16.4 


(5) 


G 


63.9 


(61) 


M 


3.1 


(6) 


T 


66. 6 


(42) 


T 


25.9 


( 4 ) 


Groups 2b 


and 2c. Two othe 


r French 


groups were tested 


twice — once 


shortly after the beginning, and again toward 



the end, of their intermediate course. As is the case of Qptmp 
2a, some of these students had entered the course directly 
from high school while others had formerly completed the 
elementary college course. The results of the two testings, 
made at slightly different points on the 180-hour scale, and 
using different levels of the aural test in the respective 
groups, were as follows: 

CO-OPERATIVE AURAL 

Group 2b (1^76) 

0CT.!34B(10SHRS.) APR.1B4«(tfOHRS.) OCT. 1 945 ( t OS HRS. ) APR.t94t(tSO HRS.) 





ADV. 


R 


ADV. 


R 




UPPER A 




UPPER 


B 






(1 YR. 




(2 YR. 














MEAN 


KILE) 


MEAN 


KILE) 




MEAN 


(tenth) 


MEAN 


(TENTH) 


R 


62.8 


(78) 


71.8 


(67) 


I 


5.6 


(4) 


4.0 


(4) 


V 


66.6 


(77) 


71.6 


(47) 


n 


15.8 


(5) 


11.2 


(5) 


G 


66.0 


(89) 


68.0 


(76) 


M 


2.3 


(5) 


4.0 


(5) 


T 


66.7 


(85) 


72.7 


(65) 


T 


23.7 


(4) 


19.2 


(5) 



er|c 
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Group 2c (N-33) 

FEB.t94t(»S HRS.) JUNE t 94«( 140 HRS . ) FEB. t94S(9S HRS . ) JUNE t94f(t40 HRS.) 





ADV. 


R 


ADV 


. R 




LOWER 


B 


LOWER 


A 






(1 YR. 




(2 YR. 














MEAN 


RILE) 


mean 


RILE) 




MEAN 


(TENTH) 


MEAN 


(TENTH) 


R 


58.3 


(63) 


68.9 


(61) 


I 


8.0 


(7) 


8.4 


(7) 


V 


66.3 


(76) 


71.0 


(45) 


u 


14.7 


(7) 


14.8 


(6) 


G 


62.7 


(83) 


66.9 


(72) 


11 


7.6 


(5) 


12.7 


(6) 


T 


63.8 


(76) 


71.0 


(59) 


T 


30.3 


(7) 


35.9 


(6) 



Both Groups 2b and 2c stood above the two-year Co-operative 
median at the second testing in all scores for the Co- 
operative except Vocabulary, and all groups were strongest in 
Grammar. On the aural test the sub-median total score of 
Group 2b at the first testing may be due in part to the fact 
that the upper- level test was too difficult for students with 
only 105 hours. 

Group 3a • This was a small group of seventeen students, all 
of whom entered the intermediate course with three or four 
years* study of high-school French in which they had made 
superior records. They took essentially the same course as 
the intermediate groups reported above, but were taught in a 
separate section in which more reading was done and more 
ground covered in all phases of the course. They thus qualify, 
in a sense, as an advanced group; consequently their scores 
on -tlh« tests, con.siderably higher than those of the preceding 



groups, are measured at 


the end in terms of the third 


-year 




. In reporting the points at 


which testing 


was done, we 


use a 


1 scale of HS 


(High 


School ) 


+ 90 


hours . 


The scores: 




CO-OPERATIVE 








AURAL 








Group 3a (J^17) 












OCT. 1945 


APR. 


1945 


OCT. 


194S 


APR. 


H946 




(HS-FIIS HRS.) 


(HS+70 


HRS.) 


(HS-t-IS HRS.) 


(HS+70 


HRS. ) 




ADV. R 


ADV 


. R 


UFFER A 


UPPER 


a 


I 


(2 YR. 




( 3 YR . 










i 


mean rile) 


MEAN 


RILE) 


MEAN 


(TENTH) 


MEAN (TENTH) 


. . R 


79.9 (89) 


85.6 


(85) I 


13.9 


(5) 


8.6 


(5) 


I - V 


76.8 (68) 


79.2 


(40) n 


23.1 


(5) 


18.4 


(6) 


1 ’ G 


67.8 (75) 


70.8 


(73) m 


2.7 


(3) 


7.3 


(5) 


T 


76.9 (80) 


82.1 


(72) T 


39.7 


(5) 


34.3 


(6) 
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Like other intermediate groups, these students ended 
weakest in Vocabulary, but unlike them they finished strongest 
in Reading rather than in Grammar. 

Group 3b. This was a small group of eleven students taking 
a survey of literature. Tested at what is roughly calculated 
on our scale as 235 hours, they produced the following scores: 



CO-OPERATIVE AURAL 

Group 3b (N~ll) 





APR. 


1946 (239 HRS.) 




APR. 1946 (235 HRS.) 






ADV . R 






UPPER 


B 






(3 YR. 












MEAN 


«DLE) 




mean 




(TENTH) 


R 


81.9 


(75) 


I 


7.7 




(4) 


V 


79.4 


(40) 


n 


17.1 




(5) 


G 


74.5 


(84) 


1¥ 


4.3 




(3) 


T 


81.5 


(70) 


T 


29.1 




(4) 


The 1 


ow aural scores of 


this 


group 


may 


possibly 



attributable to their relatively slight use of the spoken 
language in a literature course. 

Effect of previous study of French for Groups 2b and 3a. 
The scoi-es of Groups 2b and 3a on the Co-operative and Aural 
scores of the October testing were analyzed to determine the 
effect of varying amounts and kinds of previous study of 
French. There were three categories of previous experience: 
(1) no high-school study with the elementary course taken at 
the University; (2) two years of high-school French; (3) three 
or four years of high-school French. Means of these three 
subgroups on the Co-operative and aural totals were as 
follows : 



1. Qte year of college French (9 cases from Grot^ 2.b) 

2 . IWo years of high-school French (35 cases from Group 2b) 

3 . Three or four years of high-school French 

(39 cases from Group 2b, 16 from 3a) 



CO-OP- 
ERATIVE AURAL 

59.6 15.8 
65.4 24.4 
72.3 30.0 
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All the differences between the meanis of Categories 1-2, 
1-3, or 2-3 are significant except that between 1 and 2 on 
the Co-operative total. In other words, two years of hi^= 
school French are about the equal of elementary French at 
this university as far as the reading skills are concerned 
but for aural comprehension give a better base than does the 
university work. Likewise these data indicate that three or 
four years of high-school experience produce better results 
than only two, but whether the difference justifies the time 
is another question. 

Spanish 

Group 2a. One Spanish group was tested toward tlie end of 
its intermediate course. Many of the students had entered the 
course from high school; the balance, who had begun the study 
of Spanish in the university, had accumulated 90 hours in 
the elementary course and were adding 90 more in the inter- 
mediate for a total of 180 hours. On that scale the group was 
tested at 145 hours, in October 1945, with the following 
results: ^ 



CO-OPERATIVE 



AURAL 







Group 2a 


11 






OCT. J945 


(149 HRS . ) 


OCT. 1949 (149 HRS.) 




ADV. 0 




UPPER 


A 






(2 YR. 










MEAN 


%1LE) 




MEAN 


(tenth) 


R 


65 , 8 


(50) 


I 


9.0 


(5) 


V 


65.0 


(42) 


n 


22.1 


(6) 


G 


67.0 


(68) 


mu 


3.4 


(4) 


T 


67 . 5 


(55) 


T 


34.5 


(5) 


Groups 


2b and 


2c. Two other Spanish groups 


were t 



twice — once shortly after the beginning, and again toward 
the end, of their intermediate course. Approximately one half 
of these students had entered the course directly from high 
school, while the other half had completed the elementary 



^Cf. the identiol testing situstion for French Group 2a. 
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college course. The results of the two testings, made at 
slightly different points on the 180-hour scale, and using 
different levels of the Aural Test in the respective groups, 
were as follows:® 

CO-OPERATIVE AURAL 
Group 2b (NH27) 



OCT. 1 945 (t OS HRS.) 


APR. 1946 (160 HRS 


. ) OCT. 1945(105 


HRS.) 


APR. 1946(160 HRS.) 




ADV 


0 


ADV. 0 


UPPER A 




UPPER 


A 






(t YR. 




(2 YR. 












MEAN 


%ILE) 


MEAN 


%ILE 


MEAN (TENTH) 


MEAN 


(TENTH) 


R 


59.9 


(74) 


66.8 


(54) 


I 5.5 


(4) 


8.1 


(5) 


V 


59.3 


(65) 


66.3 


(48) 


I 18.8 


(4) 


24.9 


(6) 


G 


61.9 


(85) 


66.8 


(67) 


HIT 3.7 


(5) 


4.8 


(6) 


T 


61.5 


(77) 


68.4 


(59) 


T 28.0 


(4) 


37.8 


(6) 










Group 2c (N=l€) 








FEB.)948(9S HRS.) 


JUNE 


1946(140 HRS.) FEB. 1946 (95 


HRS.) 


JUNE 1946(140 HRS. I 




ADV. 


0 




ADV. 0 


LOWER 8 




LOWER 


A 






(J YR. 




(2 YR. 












MEAN 


%ILE) 


MEAN 


%ILE 


MEAN (TENTH) 


MEAN 


(tenth) 


R 


60.0 


(74) 


66.6 


(54) 


I 8.6 


(7) 


9.9 


(7) 


V 


58.2 


(61) 


67.0 


(50) 


n 11,0 


(6) 


14.4 


(6) 


G 


59.5 


(77) 


63.3 


(53) 


11 18.7 


(7) 


20.4 


(7) 


T 


60.2 


(73) 


67.3 


(54) 


T 38.3 


(7) 


44.7 


(8) 




Just 


as in 


the 


case of 


French Groups 2b and 2c 


, both 


Sp&nish 


groups 


stood above 


the two-year 


Co-operative 


median 


at 


the second 


testing in a 


11 parts except Vocabulary, and 



Groups 2a and 2b (though not 2c) were strongest in Grammar. 

Again as in French, Group 2b’ s sub-median total on the 
aural at , the first testing may result partially from taking 
the upper-level test at only 105 hours# The same form of the 
aural test was repeated at the second testing, which can 
account for the sharper rise in Spanish than in French, where 
alternate forms were used. 

Effects of previous study of Spcaiish in Group 2b. Group 2b 
-was analyzed to deterroif;! the effect of varying amounts and 



®Cf. the identical testing situation for French Groups 2b and 2c. 
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kinds of previous study of Spanish on the Co-operative and 
aural scores of the October testing. There were three 
categories of previous experience: (1) no high-school study — 
elementary course taken at the University; (2) two years of 
hi^ -school Spanish; (3) three years of high-school Spanish. 
Means if these three subgroups on the Co-operative and aural 
totals were as follows: 

CQ.OPERAI I VE AURAL 

1. One year of college Spanish (57 cases) 58.6 27.0 
2'. Two years of high-school Spanish (38 cases) 62.8 27.5 
3. Three years of high-school Spanish (24 cases) 66.5 30.6 

Here the situation is different from that in French. 
Significant at the 1 % level are the differences between the 
means of Categories 1-2 and 1-3 on the Co-operative total; 
significant at the 5% level is that between Categories 2-3 
on the Co-operative total. On the Aural total, none of the 
differences between means proved to be si§;nificant. In making 
comparisons with French, one should note that none of the 
Spanish students in Category 3 had had four years. Thus one 
extra year of high-school work makes some difference, though 
not a very significant one. 

Supplementary Data and Correlations 

For certain of the groups covered by the testing program 
at College B, we secured two bodies of supplementary data: 

(1) the individual students’ decile scores on the Ohio State 
University Psychological Examination, taken at entrance; 

(2) final grades assigned in that semester of the language 
course during which our tests were administered. The following 
are the means, by groups: 
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OHIO PSYCH. 

(LOCAL DECILE) FINAL GRADE 



French Group 2a 


5.5 


B - 


French Group 2b 


5.9 


C + 


French Group 3a 


7.7 


B 


Spanish Group 2a 


5.9 


B - 


Spanish Group 2b 


5.9 


c + 



From these figures it is clear that all groups are about 
the same in intellectual ability (and slightly higher than 
the local average) except for French 3a, which is well above 
average and was given a better grade. For these five groups 
the coefficients of various correlations of the test scores 
with each other and with the two types of supplementary data 
are shown in Table X. ^ The picture is so similar to that 
already seen at College A that only two points merit special 
comment. Here the correJations between the aural and Co- 
operative scores are slightly lower than at College A, but 
they still fall within what appears to be the usual range of 
thesd coefficients, roughly .25-. 70. The other point is that 
-French 3a, the group with- extended high school experience, 
is typical of most advanced courses in that grades have little 
relation to aural skill and the correlation between aural 
score and final grade is very low. 

College C 

At College C, a medium-sized privately endowed college, we 
were unable to arrange for a testing program which would 
follow the progress of certain homogeneous groups. Neverthe- 
less, the aural tests were used extensively at this college 
in both 1945-1946- and 1946-1947, and the Co-operative tests 

^The number of .ceaea in each group appeara a lightly reduced here, aa a 
few students had not taken the Ohio Psychological Testa and thus had to be 
omitted from the correlations. 
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TABLE X 

College B: Correlations 







CO-OPERATIVE R 


OHIO PSYCH. 


SEMESTER GRADE 




OHIO PSYCH. 






.30 


French 
Group 2a 


CO-OPErtATIVE R 




.32 


.40 


(NM3) 


AURAL UPPER A 


.46 


.35 


.30 



Partial Correlations: 

1 . Co»operative R and Aural Upper A, with Ohio score held coRStant: .39 

2. Co»operative R and Semester Grade, with Ohio score held constant: .34 

3. Aural Upper A and Semester Grade, with Ohio score held constant: ,22 

4. Aural Upper A and Semester Grade, with Co<>op. R held constant: .14 







CO-OPERATIVE R 


OHIO PSYCH. 


SEMESTER GRADE 




OHIO PSYCH. 






.34 


French 
Group 2b 


CO-OPERATIVE R 




.44 


.66 


(N=69) 


AURAL UPPER A 


.46 


.37 


.35 



Partial Correlations: 

1. Co-operatiTe R and Aural Upper A, with Ohio score held constant: .36 

2. Co-operatire R and Semester Grade, with Ohio score held constant: .60 

3. Aural Upper A and Semesver Grade, with Ohio score held constant: .32 

4. Autal Upper A and Semester Grade, with Co-op. R held constant: .07 





CO-OPERATIVE R 


OHIO PSYCH. 


SEMESTER GRADE 




OHIO PSYCH. 




.16 


French 
Group 3a 


CO-OPERATIVE R 


.41 


.52 


(N=16) 


AurAl upper a .36 


.72 


.05 



Partial Correlations: 

1 . Co-operatiTe R and Aural Upper A, with Ohio score held constant: . 10 

2. Co-operatire R and Semester Grade, with Ohio score held constant; .50 

3. Aural Upper A and Semester Grade, with Ohio score held constant: -.10 

4. Aural Upper A and Semester Grade, with Co-op* R held constant: -.17 



■j 



!| 

{ 

5 



I 

i| 

!! 

II 

I 

I 

i 

I 

I 

II. 

i 









\ 



er|c 
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TABLE X 

(continued) 

CO-OPERATIVE 0 OHIO PSYCH. SEMESTER GRAOE 



OHIO PSYCH. .07 

Spani$h 

Group 2a co-operative q .10 .38 

(N=58) 

AURAL UPPER A .29 .23 .23 

Partial Corraiationa: 

1. Co-oparatiTe Q and Aural Upper A. with Ohio acorc held conatant: .28 

2. Co-oparatiTe Q and Saoaeatar Grade, with Ohio acore held conatant: .36 

3. Aural Upper A and Seeiaatar Grade, with Ohio acore held conatant: .23 

4^ Aural Upper A and Saaieater Grade, with Co-op. Q held conatant: .14 



CO-OPERATIVE 0 





(OCTOBER) 


OHIO PSYCH. 


SEMESTER GRAOE 




OHIO PSYCH. 




.26 


Spanish 
Group 2b 


CO-OP. 0 (OCT.) 


.42 


.58 


(N=ii8) 


AURAL UP. A (OCT.) .43 


.35 


.26 


Partial 


Corraiationa: 







1. Co-oparatira Q and Aural Upper A. with Ohio acore held conatant: .33 

2. Co-oparatira Q and Semeater Grade, with Ohio acore held conatant: .27 

3. Aural Uppar A and Seaaater Grade, with Ohio acore held conatant: . 19 

4. Aural Upper A and Semeater Grade, with Co-op. Q held conatant: .17 

were administered at the end of each year, and the results 
were submitted to us for comparison with the aural achievement. 
During the first of the two years no experimental courses 
were in operation at the college; all courses were of the 
conventional eclectic type, and we present the test results 
in this chapter as representative of such courses in an 
institution which enjoys excellent national reputation. 
During the second year (1946-1947), experimental courses were 
inaugurated in French and Spanish. These, as well as the 
parallel conventional courses, were covered by our testing, 
and the results for that year appear in Chapter Vl. 
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In 1945-1946 Form A of the aural tests was given to all 
classes having sufficient hours at the end of the first 
semester, and Form B was administered at the end of the 
year. Thus numbers of individual students were tested aurally 
twice; but because of constant shifting of enrollment from 
semester to semester some students discontinuing,, others 
entering from high school, still others (veterans, for 
example) resuming the language after a lapse — no single 
group maintained a constant personnel through even two 
semesters. We tabulate below the scores for the June testing 
only; the full table in Appendix B indicates, in a series of 
notes to each group, the scores made by certain members on 
either a previous or a subsequent aural testing. 

All groups in both French and Spanish met in class three 
hours per week for a total of approximately 45 hours per 
semester. In either language. Group 1 had completed one 
year, Group 2 had completed one and one-half years, Group 3 
had completed two years, and Group 4 (made up of students 
taking various advanced courses) had completed at least two 
and one-half years. - The results by groups; 







CO-OPERATIVE 




AURAL 






ADVANCED 


FORMS* 




LOWER B 






MEAN 


(%ILE) 




MEAN 


(TENTH) 


Spanish 


E 


60.1 


(74) 


I 


5.7 


(5) 


Group 1§ 


Y 


59.1 


(64) 


n 


8. 5 


(5) 


90 hours 


G 


66.7 


(94) 


M 


13.6 


(5) 


(N=.*i6) 


T 


63.4 


(82) 


T 


27 .’8 


(5) 


French 


n 


63.9 


(38) 


I 


6.9 


(6) 


Group 2 


V 


69.7 


(38) 


1 


13.8 


(5) 


135 hours 


G 


61.2 


(39) 


11 


10.5 


(6) 


(N=53) 


T 


66.5 


(41) 


T 


31.1 


(6) 



'^Form P in Spanish, Foroi Q in French. 

JFor reaaona not ascertained by na, the second- semester French group was 
not giren the aural test. 
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CO-OPERATIVE 




AURAL 






advanced 


rORMSi 




LOWER ■ 






MEAN 


(sac) 




MEAN 


(TENTH) 


Spanish 


R 


66. 5 


(S3) 


I 


9.8 


(5) 


Group 2 


V 


64.3 


(40) 


o 


12.8 


(5) 


135 hours 


G 


69.2 


(76) 


M 


17.6 


(6) 


(N-35) 


T 


68.6 


(59) 


T 


40.2 


(6) 


French 


R 


65.5 


(43) 


I 


4. 1 


(4) 


Group 3 


V 


70.1 


(40) 


a 


9.5 


(5) 


180 hours 


G 


62.0 


(52) 


M 


3.3 


(4) 


(N*23) 


T 


67.0 


(43) 


T 


16.9 


(4) 


Spanish 


R 


69.4 


(65) 


I 


11.1 


(5) 


Group 3 


V 


67.9 


(54) 


1 


7.9 


(6) 


180 hours 


G 


69.7 


(78) 


m 


5.1 


(4) 


(N-25) 


T 


70.8 


(68) 


T 


24.1 


(6) 


French 


R 


82. 1 


(75) 


I 


9.6 


(6) 


Group 4 


V 


79.6 


(41) 


n 


17.1 


(5) 


225 hrs. or more 


G 


71. 1 


(74) 


nr 


6.. 7 


(5) 


(N-27) 


T 


80.6 


(66) 


T 


33.3 


(6) 


Spanish 


R 


73.^ 


(50) 


I 


IS. 1 


(5) 


Group 4 


V 


77.4 


(56) 


1 


16.9 


(6) 


225 hrs. or more 


G 


75.3 


(81) 


m 


8.8 


(5) 


(N-30) 


T 


78.0 


(67) 


T 


40.9 


(6) 



For all three groupa where both languages are represented - 
(namely 2 , 3, and 4), the Spanish norm percentiles are higher 



than the French on the Co-operative Test. Soanish Group 2, 
for example, had already at midyear surpassed the median of 
the two-year norms, while French Group 2 had not. The only 
instance of a higher percentile in French is that of the 

Beading in Group 4. An outstanding feature of the Spanish 

* 

picture (similar to that in Spanish at College B) is the 
predominantly high level of performance in Grmiinar, apparent 
in all groups, which gives direct evidence of precise training 
in that aspect ot the language. Beading development did not 
suffer, however, all scores being above the median in that 
department, though the Vocabulary scores tend to run low. 
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Qti the other hand, as is neatly demonstrated in a series of 
Co-operative scores from College G (see below, p. 152), a high 
degree of reading success can also be achieved with a minimum 
of grammatical analysis and a maximum of vocabulary control. 

The various aural scores for College C offer no noteworthy 
interrelations, and none of them deviate more than one decile 
from the median of the appropriate norm-grouji . It must be 
admitted that one of the reasons for this uniformity is the 
fact that College C was by far the largest single contributor 
to the norm-distributions for the B forms of the aural tests. 

Correlations betweejn Visual and Aural Jests 

The following are the coefficients of correlation between 
the Co-operative and the aural tests (total scores) at College 
C; 



Spanish - Group 1: 


.24 


French - Group 2: 


.63 


Spanish - Group 2: 


.65 



French - Groups 3-4 (combined) .SB 
Spanish - Groups 3-4 (combined) .51 



The Group 1 correlation is characteristically low,' these 
students being at a stage where their aural comprtithension 
was relatively undeveloped. For Group 2, with wily one- half 
year more of instruction, the rise above Group 1 is sur- 
prisingly sharp, and the figures are unusually close together 
in the two languages. The slight drop in Groups 3-4 is only 
apparent and not real. • 

College D 

At College 0, a small liberal-arts college, although 
oral-aural work was regarded as being of secondary importance 
as compared with the visual skills, a plan was developed for 



147 






GROUPS NOT STRESSING AURAL-ORAL OBJECTIVES 

19.45-1946 whereby a maximun of opportunity for aural practice 
could be provided through laboratory work with the phonograph. 
Elementary courses in the three languages offered at this 
college — French, German, and Spanish — held four class 
meetings per week; in addition, the students attended two 
supervised laboratory hours each week for work with tran- 
scriptions of locally recorded materials related to their 
course of study. Intermediate (second-year) classes operated 
under this same plan during the first semester, but at 
midyear discontinued the two hours of laboratory. 

The elementary groups in all three languages were tested 
at the end of the first semester, when they had accumulated 
90 contact hours (inclusive of the laboratory hours). The 
results: 

CO-OPERATIVE AURAL 



Frtnch 





ADV. 


• 




LOWER 


A 




mean 


(SILE) 




MEAN 


(TENTKli 


R 


48.0 


(26) 


I 


3.2 


(4) 


V 


60.0 


(52) 


II 


8.5 


(3) 


G 


59.8 


(73) 


TUT 


9.2 


(5) 


T 


56.3 


(47) 


T 


20.9 


(4) 








German (N~30) 






R 


51.9 


(34) 


I 


4.8 


(5) 


V 


54.9 


(44) 


n 


6.1 


(4) 


G 


52.9 


(51) 


M 


6.5 


(4) 


T 


53.2 


(40) 


T 


17.4 


(5) 








Spanieh (N^O) 






R 


52.3 


(42) 


I 


3.2 


(4) 


V 


51.2 


(32) 


n 


8.3 


(3) 


G 


54.3 


(57) 


M 


10.4 


(3) 


T 


52.7 


(44) 


T 


22.0 


(3) 



*Torm Q in Frnnelli, P in Carman, and Q in Spanisli. 



In all three languages the highest percentiles on the 
Co-operative tests are in Grammar. At midyear the totals are 
all reasonably near the median for oiie year of study. These 
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same groups were re-tested at the end of the year; but 
through an oversight the Co-operative results were not made 
available to us, and the aural scores are of minor interest 
because not only was the same form of the test (Lower Level 
A) repeated, but also the groups had become substantially 
reduced in size. The scores from this testing appear in 
Appendix B; it is sufficient here to record that in the 
total, the French group progressed to the 5th tenth, the 
German to the 8th tenth, and the Spanish to the 7th tenth, 
of Norm-group IB. 

Correlation coefficients between total scores on the 
Co-operative and the Aural Tests for the midyear testing were: 
for French .67; for German .80; for Spanish .40. The unusually 
high coefficient in German is explained by the cases of two 
students who made inexplicably high scores on both tests; 
with these two cases excluded, the figure is .66. After only 
one semester’s instruction, even at the rate of six hours per 
week, the French and German correlations are surprisingly high. 

The intermediate groups in the three languages were also 
tested, but they took the lower-level aural examination only 
a^: the end of the year when, as in the case of the elementary 
groups, their Co-operative scores were not available to us. 
In French and Spanish these groups placed in the same tenth 
of their norm-group as did the elementary groups on their 
end-of-year re -take of the Aural, while in German they placed 
only in the 5th tenth as contrasted with the beginners who had 
jumped to the 8th. Full scores of the intermediate groups 
appear in Appendix B. 

College E 

Basic language courses at College E, a large city university, 
had been modified by current influences to the extent of 
supplementing the traditional three hours of class per week 
by a single drill-*session of one hour and a half. This drill- 
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period was devoted to oral and aural work, mainly "conversa- 
tion", under the direction of a native speaker. It was first 
instituted with the elementary classes in 1944-1945, and was 
put into the intermediate course the following year., Thus the 
elementary groups, when tested in May 1946, had accumulated 
approximately 90 class -hours plus 45 drill-hours for a total 
of 135 running hours; the intermediate .groups had accumulated 
90 hours (without benefit of dr ill -sessions) the first year, 
and had then added 135 hours under the new arrangement for a 
total of 225. The results of the testing program, by French 
and Spanish elementary and intermediate groupd: 

CO-OPERATIVE AURAL 
French Group 1 135 hours (fhi07) 







A0V.* 




LOWER 


A 




mean 


<KILE) 




MEAN (TENTH) 


R 


57.1 


(59) 


I 


3.8 


(5) 


V 


56.5 


(35) 


n 


10.2 


(4) 


G 


56.0 


(57) 


nr 


7.9 


(4) 


T 


57.7 


(55) 


T 


21.9 


(4) 




Spanish Group 1 


135 hours 


(N=129) 




R 


61. U 


(80) 


I 


5.9 


(6) 


V 


57.5 


(60) 


II 


11.3 


(6) 


G 


54.2 


(57) 


TIT 


13.7 


(6) 


T 


58.7 


(68) 


T 


30.9 


(5) 






French Group 2 


225 hours 


(i^47) 












UPPER 


A 


R 


80.0 


(89) 


I 


9.5 


(6) 


V 


77.2 


(69) 


n 


17.1 


(5) 


G 


71.3 


(86) 


IK 


4.0 


(7) 


T' 


78.9 


(86) 


T 


30.5 


(6) 






Spanish Group i 


j 225 hours (/\^74) 




R 


70.5 


(67) ' 


I 


9.9 


(6) 


V 


75.8 


(82) 


II 


21.9 


(6) 


G 


69.5 


(79) 


M 


4.9 


(6) 


T 


74.2 


(79) 


T 


36.7 


(6) 



*Totu R for French, Form Q for Speninh 

These results again reflect the typical situation, 
characterized by scores well above the median in the reading 
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skills, but by only average, or slightly better, aural 
achievement . The intermediate groups , with the two languages 
very near one another in general level of achievement 
performed better than the elementary groups both visually 
and aurally. The comparative lack of success for French 
Group 1 in both areas may be due to various incidental 
factors (e.g., intelligence); no data is available on which 
to base any explanation. 

College F 

i! 

Our program at College F, a large city college, was 
limited to 128 students of elementary German. They are of 
interest chiefly as a conventionally taught group who were 
tested at the end of their first semester after only about 
50 hours of class instruction. The scored: 



CO-OPERATIVE AURAL 





ADV. 


FORMS* 




LOWER 


A 




MEAN 


(%I1LE) 




mean 


(TENTH) 


R 


46.9 


(18) 


I 


3.8 


(5) 


V 


53.2 


(36) 


n 


4.4 


(5) 


G 


51.2 


(43) 


n 


5.0 


(5) 


T 


50.2 


(29) 


T 


13.2 


(5) 



*ForBS N, 0, anidl P wera used in about equal nuiabara, diatributad according 
to eliaa saetions. 

Although it is not altogether fair to measure the per- 
formance of these students against the one -year Co-operative 
norm, it is interesting to note that at midyear they were 
least advanced in Reading, farthest advanced in Grammar, 
and on the Total were about half-way between the bottom and 
the median. That their aural scores are in the 5th tenth on 
all pai'ts of the test is due partly to the fact that they 
constituted one -third of the cases making up German Norm 
Group lA. 
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The coefficient of correlation between the two tests 
(total scores) is .46, a passably high figure for a group all 
leases of whose proficiency *in (jerman were in the earliest 
stages of development. 

College G 

College G, a lajrge city univei'sity, cannot be regarded as 
producing second -language outcotiKs typical of the country as 
a whole. The language students constitute a representative 
sample of the student body, which as a whole ranks exceptionally 
high in intelligence as measured by the ACE Psychological 
Examination. The elementary language course, which meets four 
hours per week for a total of approximately 105 hours, is 
designed to give students an adequate reading knowledge of 
the language in one year. At the same time oral' and aural 
practice is not neglected; the phonetics of the language are 
studied systematically, and in their four class meetings each 
week the students have ample practice in handling the spoken 
idiom in connection with their reading, the bulk of which is 
covered out of class. 

Our testing program at College G consisted in following 
four successive groups of elementary students in French, and 
one such group in Spanish. Each group was given the Co- 
operative tests at 35 hours and at 70 hours, and both the 
Co-operatives and the aurals at 105 hours, i.e., at the end 
of the course. The form of the Co-operative test used at each 
successive testing was the same, and the aural test was the 
lower level. The following are the results of the final 
testing. 



^In tabulating the French groupa we deaignate them aa Groupa la, lb, Ic, 
and Id. Group Ic ia actually dirided into two aubgroupa, one conaiating of 
atudenta who had had no prerioua inatruction in French, and the other of 
atudenta who had atudied French prerioualy in aecondary achool. 
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CO-OPERATIVE , AURAL 



French Group la (iSH^lHS) N=31 





ADV. R 




LOWER 


A 




MEAN 


(%ILE) 




MEAN 


(TENTH) 


R 


84.1 


(99) 


I 


6.4 


(7) 


V 


82.4 


(99) 


n 


16.7 


(8) 


G 


57.6 


(65) 


n 


11.6 


(7) 


T 


77.3 


(99) 


T 


34.7 


(8) 






French Group lb (1945-1946) hkl3 




R 


84.0 


(99) 


I 


8.9 


(9) 


V 


84.1 


(99) 


H 


18.9 


(9) 


G 


54. 3 


(49) 


m 


10.9 


(5) 


T 


76.5 


(98) 


T 


38.6 


(8) 






French Group Ic.l (Summer 1946) N^13 




R 


82.5 


(99) 


I 


6.7 


(8) 


V 


81.0 


(99) 


n ■ 


13.2 


(7) 


G 


58.2 


(65) 


M 


15.0 


(8) 


T 


76.5 


(98) 


X 


34.9 


(8) 






French Group lc.2 (Summer 1946) Ns 15 




R 


85.0 


(99) 


I 


7.3 


(8) 


V 


80.5 


(98) 


n 


13.3 


(7) 


G 


59.3 


(69) 




13.4 


(7) 


T 


77.6 


(99) 


T 


34.1 


(8) 




French Group Id (Feb.’^Aug. 


1946) Ns 16 




R 


88.0 


(99) 


I 


10.2 


(9) 


V 


81.8 


(99) 


n 


16.9 


(8) 


G 


56.9 


(61) 


jii. 


17.3 


(8) 


T 


78.4 


(99) 


T 


44.3 


(lb) 




AOV. 0 Spanieh Group 1 


m20 






R 


75.3 


(99) 


I 


10.1 


(9) 


V 


79.8 


(99) 


E 


14.6 


(9) 


G 


71.3 


(98) 


Hf 


18.8 


(8) 


T 


77.8 


(99) 


T 


43.5 


(9) 



In both French and Spanish, the unfailingly high achievenment 
of these students on the Co-operative tests is due chiefly to 
the fact that they, read exceptionally large amounts in the 
carefully graded Heath-Chicago series of readers as well as 
in ungraded material. These readers, like the Co-operative 
Tests, are based on the frequency counts of vocabulary and 
structural patterns, and hence the students are well equipped 
to handle the tests. Doubtless, also, a third exposure to the 
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same form of a Co-operative test is not unlikely to produce 
a somewhat higher range of scores than would be attained on 
the third of three different forms. Nevertheless on the first 
testing, at 35 hours, the percentiles for the total means 
range from 55 to 84; and on the second testing, at 70 hours, 
the percentile range is between 91 and 97. Finally it is 
worth pointing out that performance at the end of one year, 
measured against the two-year norms, ranges from the 77th 
(French Group lb) to the 89th (Spanish Group 1) percentile. 

That, in French, the Graimnar scores are consistently far 
lower than those for Beading and Vocabulary is a direct 
reflection of lack of stress on grammatical analysis and 
practice in this course. The Beading and Vocabulary scores 
are, however, so compensatingly high (actually standing 
above the 99th percentile) that the total scores still stand 
at the top. In Spanish there is an equilibrium which reflects 
a development of granimatical competence on a par with reading 
ability, which itself runs slightly lower than in French. 

Despite the major emphasis on reading, the consistently 
high "aural scores demonstrate that aural skill can be a 
successful by-product of the "extensive-reading method." 
Ghee again the command which these students have of the high 
frequency vocabulary and constructions stands them in good 
stead when taking the aural tests based on these same counts. 
Correlation between the reading and aural skills is generally 
high as a result, though all the groups are relatively small 
and hence the coefficients are subject to considerable 
sampling error. French Group Id, which made a higher aural 
score than the others, was made up entirely of war veterans, 
some of whom had seen service in France or North Africa. 

Both French Group Ic and the Spanish group were given the 
elementary course in a single summer. This was accomplished 
simply by tripling the pace of the course, with twelve class 
meetings a week and with no diminution of assigned readings. 
Judged in the light of the test results, this form of 
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acceleration was neither more nor less effective than the 
normal pace. 

Effect of previous study. It is usual for some students 
with one or two years, previous experience in the language to 
enter these elementary courses at College G. Of French Group 
la, eight of the thirty-one students had already studied 
French in school. These eight surpassed the rest of the group 
by 2.0 points on the Co-operative total at the first testing, 
mainly on the strength of grammatical knowledge; but there- 
after, although maintaining a grammatical superiority, they 
fell slightly .below the others on the Co-operative total, 
and 4.2 points below them on the Aural. ' 

French Group Ic was split almost evenly between students 
with and without high school experience. Differences between 
their performances at the end of the course are seen to be 
negligible; at the first testing (35 hours) Group Ic. 2 surpassed 
the other by 3.0 points on the Co-operative total, and at the 
second testing (70 hours) by 2.9 points. At no stage did any 
one of : the differences prove to be significant. As usual^ 
previous study, which does not yield advanced standing, gives 
a student some initial advantage but this head start is lost 
by the end of a college year. 

High School A 

i: ' ' ■ 

In only one high school, out of dozens that made use of 
the Investigation’ s 'Aural Tests, were the Co»operative Tests 
administered as well. This was a small private school with a 
student body 'selected for intelligence. Foreign languages were 
taught in small class sections by instructors interested in 
oral -aural development and competent to teach the spoken 
idiom, along with reading .and grammar, with the maximum of 
effectiveness i possible in a weekly schedule of four hours. 
French 

The elementary group in French was tested at the end of 
the year 1945-1946. The second-year and third-year groups we 
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were able to follcw throughout the year, giving them the aural 
tests in October, and both Aurals and Co-operatives in June. 
The following results were obtained from the three groups: 

CO-OPERATIVE AURAL 

French Group 1 (N=33) 

JUNE (too HRS.) JUNE (tOO HRS.) 

ELEM. R LOWER A 





MEAN 


(%ILE)* 




MEAN 


(TENTH) 




R 


49.4 


(75) 


I 


4.9 


(7) 




V 


47.9 


(53) 


1 


9.5 


(6) 




G 


48.5 


(52) 


TMf 


5.7 


(5) 




T 


48.1 


(62) 


T 


20.1 


(6) 








French Group 2 ('iVt27) 






JUNE 


(200 HRS.) 




OCTORER 


(no HRS.) 


JUNE (200 1 




ADV. Q 




LOWER A 


LOWER B 




MEAN 


(%1LE)* 




MEAN 


(TENTH) 


MEAN 


R 


67.6 


(84) 


I 


4.9 


(7) 


I 12.2 


V 


64.7 


(70) 


I 


14.8 


(8; I 17.6 


G 


64.7 


(74) 


m 


9.1 


(7) ■ 10.0 


X 


67.2 


(77) 


T 


28.7 


(9) T 39.8 








French Group 3 (N^9) 






JUNE 


(300 HRS.) 




OCTOBER 


(210 HRS.) 


JUNE (300 




ADV. Q 




UPPER A 


UPPER 1 




MEAN 


(%ILE)* 




MEAN 


(TENTH) 


MEAN 


R 


83.3 


(93) 


I 


11.0 


(9) ] 


[ 7.2 


V 


76.9 


(73) 


M 


14.4 


(5) 1 16.2 


G 


73.6 


(78) 


iir 


3.4 


(6) M 8.0 


T 


80.8 


(86) 


T 


28.9 


(7) T 31.4 



The percentiles are fron the norms for Public Secondary Schools of the 
East, Middle West and West: Booklet of Norme, pp. 21-24. 



It should be kept in mind that the Co-operative norms for 
hig^ schools are based exclusively on results obtained from 
public school students. No norms have been issped for private 
schools; there are reasons for believing that if available, 
such norms would range higher than the existing ones, and that 
in competition with other private -school students the present 
groups might not measure as high as they do. The chances seem 
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good, however, that at least Groups 2 and 3^^ would stand 
above the median. 

These groups' aural scores give evidence of high aural 
competence as compared with other secondary school students 
at equivalent stages of study. (The aural norms are based on 
combined samples from public and private schools, with public 
schools predominating.) Unfortunately, not enough high-school 
scores on the B forms of the aural tests were obtained to 
malke possible the establishment of norms. Craisequently, aural 
progress of Groups 2 and 3 from October to June cannot be 
measured precisely. 

Spanish 

(]lily one group was tested in Spanish at High School A, and 
only at the end of the year. This was a second-year class of 
28 students, which at 200 hours produced the following results 
on the Co-operative and aural tests: 



CO-OPERATIVE AURAL 





ADV. 


0 




LOWER 


A 




MEAN 


(SILE)* 




MEAN 


(TENTH) 


R 


47.3 


(24) 


1 


3.8 


(4) 


V 


46.4 


(21) 


n 


8.1 


(4) 


G 


51.8 


(42) 


If 


12.5 


(6) 


T 


48.6 


(30) 


T 


24.3 


(4) 



*Booklet of Notma, pp. 27-SO. 

It« is obvious that the Spanish group's performance was 
considerably inferior to that of the French second-year class. 
It seems likely that this difference is attributable to a 
difference in methods and objectives. The French group- read 
in quantity, aimed to acquire a large high-frequency vocabulary, 
and covered all the fundamentals of grammar -* all of which 
COTistituted a certain direct preparation for the Co-operative 
test; at the same time they received enough ear training to 
assure them a degree of success with the aural tests, whose 

word and idiom content they were equipped to handle. The 

liThc Group 2 total of 67.2 is at ths 43rd parcsntiia of tSie two-yaar 
eolls(a DorBSn and ths Group 3 total of 80.8 ta at tha 68th parcautila of 
tha thraa-yaar col lags noraa-. 
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Spanish group, on the other hand, was directed toward the 
coirplete mastery of a imore limited set of objectives. They 
read comparatively littlej they mastered a small vocabulary 
of a few hundred basic words; they learned to manipulate pre- 
cisely certain basic grammatical forms (chiefly verbs and 
pronouns) but did not attempt to cover the full range of 
Spanish structure; they' had relatively little aural training 
but much work in oral production, which consisted in the 
memorizing and performing of short skits. Their competence 
was hi^ within very narrow limits, but it was not the kind 
that could produce hi^i scores on such broad measures as the 
(^-operative and aural tests. 

SUMMARY 

In this chapter we have presented the results obtained by 
fairly extensive testing programs at seven colleges and oi^e 
high school. Our purpose has been to give a picture of 
conventional languagie teaching, partly to serve as a basis of 
comparison with the e:iqperimental programs we shall examine 
next and partly to show what the general state of language 
teadiing is. 

In regard to the reading skills -- to which these schools 
give primary or almost exclusive attention — the results, on 
the whole, tend to be better than average. As we have noted, 
this outcome stems in part from the fact that these are 
institutions v^ose reputations for academic standards, calibre 
of student, and the like are also average or better. We should 
also expect that sdiools willing to co-operate with an outside 
evaluating agency would be those vdio are proud of their work 
and convinced that they are doing a better than ordinary job. 
In the aural skills, to which most of these schools give only 
very secondary attention, the results run at about the medians 
of the norms baused on conventionally trained students like 
these. 
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These generalizations about the programs as a whole should 
not blind us to the great diversities within them, variations 
probably produced to some extent by the quality of student 
and similar factors but undoubtedly also conditioned by 
the procedures and teaching skill employed. It is difficult to 
make comparisons fairly; but, whatever the causes of the 
differences, the reader can readily see how varied are the 
results produced by "100 hours of conventional college 
instrubticHi" in French or Spanish. 

The numerous correlations drawn from these data (many of 
which were not reported on the preceding pages because they 
merely duplicated the established pattern) indicate rather 
clearly the relation between the reading and aural skills. 
For all languages, at instructional levels from one college 
semester to three college years, the vast majority of co- 
efficients between the aural and the Co-operative scores fall 
within the range .30>.60. (Others, which fall outside this 
range but within that of .20-. 80, are usually definitely 
explicable for a specific reason and hence should be dis- 
regarded. ) The usual relation gives little assurance that 
aural skill necessarily accompanies reading skill or vice 
versa. We who teaches reading will not produce students who 
necessarily understand the language when spoken; he who 
teaches aural comprehension will not find his studenti^ 
automatically developing into competent readers. When both 
the scores in the two sorts of skills and their correlation 
tend to be high (as, for example, at College G)„ one finds 
that a specific reading program has been effectively c».'mbined 
with a specific aural program. This lack of relation between 
the skills exists even in these conventional programs for 
whose students the problems of the vocabulary in the aural 
*tests (which we have explained in Chapter 2) does not exist. 
In the following chapter we shall see how the addition of this 
further factor makes the cleavage between the skills even 
greater for the experiirental programs. 



Chapter VI 



Experimenlal Groups Stressing Aural -Oral 
Skills as an Initial Objective and 
Introduction to Reading 



Eight colleges and three high schools furnished the 
Investigation with varying amounts of data — test results 
and supplementary records — by vdiich to judge the effectiveness 
of present-day experiments in the teaching of a second 
language with aural-oral emphasis. We could not hope to 
investigate any very large percentage of the experiments. We 
could only select a sample, and this sample was determined by 
some factors other than the nature of the experiments 
themselves; for example, by the willingness and ability of 
course directors to collaborate fully wi.th us in arranging 
testing programs and compiling supplementary data. By the 
same token it seems to us probable that the very programs 
whose directors welcomed and facilitated our investigations 
were exactly those likely to have the most precise objectives, 
to be organized the most efficiently, to utilize the most 
effective methods, and to obtain the most satisfactory results. 
In other words, even though we were not appraising the complete 
picture, it seemed unlikely that few if any of its striking 
features would be absent from that section of it which we were 
studying. 

The programs of our eleven institiitions are in agreement 
in respect to their general objective, which is to turn out 
Student.^ who can use the foreign language in both its spoken 
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8nd its written form. Short of this go&l| no t\mo are identical 
in regard to student selection, type of instructional staff, 
course organization, teaching materials, special resources 
employed, and the like. We shall give as full a picture as 
possible of these particulars as we deal in turn with each 
experiment; in our concluding chapter we shall make such 
generalizations as seem justified in the face of the 'consider- 
able diversity of approach manifested by the several programs. 

College H 

Oar data from College H (a large university with a privately 
endowed college of arts and sciences) consist of two sets of 
findings which require separate treatment. A two-year period 
of limited experimentation at this college preceded a complete 
reorganization of the foreign- language curriculum with full 
conversion to semi -intensive oral-aural instruction at the 
basic level. We were able to follow the original experiment 
to a certain extent, and the new plan in detail during its 
first year. While respective results do not lend themselves 
to significant conpturisons, it is interesting to have followed 
the evolution of experimentation in a single college through 
two stages, and to note the successive developments in 
organization and procedure.^ 

i. Experiments Pre=Dating Full Reorganization 

of the Language Curriculum 

In 1944-1945 and 1945“ 1946 the IDepartment of German at 
College H experimented with new courses at the first- and 
second-year levels. These courses aimed to develc^ ability to 
use the spoken language, and therefore provided for mimicry 
and memorization of colloquial materials in small drill gi'oups 
under the guidance of native ;^eakers, as well as for formal 
instruction in grannmar. Reading was also t angb t, in the latter 

^similar erolution of experimentation from tentative beginninKs is to be 
noted elaewhere, e.g.J at College L. 
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part of elementary course and throughout the intermediate 
course. At either level the student was free to enroll in a 
"regular" group meeting four hours per week (three of drill 
and one of grammar) for a total of 60 hours per semester, or 
in an "intensive" group meeting ei^t hours per week (six of 
drill and two of grammar) for a total of 120 hours, i.e., the 
equivalent of one year in a single semester. 

The Investigation' s tests were administered at irregular 
intervals to both intensive and regulaur groups during 1944*1945 
and 1945-1946, but the resultant data are so diffuse that no 
meaningful conclusions can be drawn from them. For one thing, 
some students took the intensive elementary course and 
afterward c^tinued with the regular intermediate course, 
vdiilo others who had taken the regular elementary course 
followed it with the intensive intermediate course. This 
brought about a shifting of group enrollment from semester to 
semester, so that no single group remained homogeneous; and 
since %sting was casual, few individual students were followed 
straight through two years' work. ^ All in all, the results 
are nots conclusive enough to warrant a statement here 
conceming the effectiveness of these first experiments in 
German at^ College H. 

il ^ 

■ . ^ 

2. Reorgardzation of the Foreigyi^Lang/uage Curriculum 

In the|fall. of 1946» a completely revised program of 
modern foreign -language teaching was instituted at College H. 
Administratively the new plan brought basic-level instruction 
in Romuice, Germanic, Slavic, and Oriental languages together 
into, a single modeni- language di vision, ,-wth unified objectives 
Old procssdures. * Educationally, the revision constituted a 
civilian adaptation of the type of program originally planned 

^Teit BC0T9B lor 1945-1946 oro' tolmlotod in Appendix B. 

^Ckineee, French, German, Italian, Huaaiani and Spaniah were offered in 
1946-1947. The addition of Portugeae waa aeheduled. f or 1947-1948, and of 
Poliah for 1948-1949. 



162 



AN INVESTIGATION OF SECOND- LANGUAGE TEACHING 



for the ASTP, and it was an adaptation made on the largest 
scale yet attempted in an American college, affecting all 
elementary and intermediate language students in the institu- 
tion. Successful functioning of the plan during the first 
years of experimentation and adjustment was insured by a 
substantial grant to the university from a national foundation. 

We believe that the "orthodoxy" of the new plan, from the 
point of view of the kind of oral- aural approach developed 
in i.he ACLS Intensive Language Program (see above, p. 1) 
and in the ASTP, justifies the devotim of several paragraphs 
to its objectives, organization and procedures. In respect 
not only to this orthodoxy itself, but to the extent of its 
application within a single institution, the College H plan 
is our most outstmiding example of extensive experimentation. 

Objectives. The new plan aims to develcp basic competence 
in (1) speaking and understanding the language .s used by 
natives, end (2) in reading works written in the language. 
Both these abilities are regarded as desirable and legitimate 
goals within the field of liberal education. Given this 
two- fold objective, the assumption underlying the method of 
instruction is that the most efficient and most thorough way 
to comprehensive mastery of a language is through initial 
preocetpation with its spoken form as used by natives in their 
daily ccmiiinmications. Thus, learning to use the spoken language 
becomes the initial aim of instruction, toward which a mayor 
effort is directed in the first semester of study. 

Organization and procedure. In order to provide the 
continuous opportunity for practice necessary to the develi^- 
ment of oral and aural facility, the elementary and intermediate 
courses are organized on a semi -in tensive basis of eight 
contact hours per week. Within this eight-hour system the 
two- fold approach co-ordinating analysis and drill practice is 
employed. Two of the eight hours are spent in a large lecture 
section, accomnodating up to fifty students, presided over by 
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the linguist in charge of the course and devoted to discussions 
on the stru.cture of the language. The remaining six contact 
hours are slpent in drill sections devoted to oral and aural 
practice (imd ultimately also to work with reading texts) 
under the supervision of a native-speaking instructor; in 
these sessims the opportunity for maximum individual partici- 

, 'I 

pation is insured by limiting the number of students to ten. 

A basic sequence of two courses is provided: the elementary 
and the inUsrmediate. Each covers one fifteen-week semester 

■i 

and thus at eight hours per week accumulates a year’s total 
of 240 contact hours. Outside preparation for class hours is 
expected in af^roximately a one-to°one ratio; course credits 
assigned are six per semester as contrasted with three for 
other course's; thus all in all, the one-semester intensive 
course is to>be equated with a one-year course, and the two- 
semester sequence with a two-year course. 

Hie staff participating in the program consists of a 
ranking member in diarge of each Icuiiguage, whose role is (a) 
to teach the large lecture sections, endeavoring to iq)ply 
modem techniques of linguistic analysis to the material being 
concurroitly assimilated by the learners in the drill sessions, 
end (b) to organize and supervise the work of the native 
instructors aiid to co-ordinate the activity of the numerous 
drill sections. The natives who have instructorial or graduate- 
assistant status are recruited from a variety of sources: a 
few were members of the d^artmental staff before the adoption 
of the new plan; others are natives expressly imported to 
serve on a full-time teaching basis; several are foreign 
graduate students pursuing their own studies at the university 
and earning tuition by serving as language teachers. In the 
-future it is planned to procure a steady supply of such 
personnel on a basis of mutual exchange of students between 
College H and foreign institutions. It goes without saying 
that, in such a plan of staff procurement, experience in 
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teaching one’s native language is not a prerequisite for 
service. The plan assumes that success in drilling students 
orally and aurally in one’s o\Mn language does not require 
pedagogical training of the conventional sort, and that such 
training may indeed lead an instructor to deviate from his 
primary function and attempt to teach the grammar of his 
language according to criteria other than those adhered to by 
the linguist handling the analytical phase of the course. 
Instructors are transferred from one drill group to another at 
least once during each' semester, so that a student’s experience 
with the spoken language includes familiarity with more than 
one native speech-pattern. As soon as the individual students’ 
learning ability and progress rate can be reliably appraised — 
normally after six or eight weeks of instruction, — they are 
segregated into "fast" mid "normal" groups in order that all 
may benefit by drill techniques best adapted to their 
capabilities. 

The texts used for oral-aural work in the elementary and 
intermediate courses are the series entitled Spoken French, 
^oken Gentian, etc. originally prepared for the United States 
Armed Forces Institute and now available for general civilian 
use. All follow essentially the same plan and are well suited 
to use in an eight-hour-per-week program: each lesson, or 
unit, contains a sufficient amount of drill material for six 
hours, ^ and a "word study" section around \diich the linguist 
may profitably organize two hours of discussimi. Approximately 
half of the thirty units are covered each semester. 

After instruction in reading is begun, late in the 
elementary course or at the beginning of the intermediate, two 
or three of the six weekly drill hours are devoted to it. 
While explanation of puzzling words or constructions is 
provided, translation of the text into English is avoided in 

^For ex«mple: mimicry-memoriiiition of "Busic Sentence*", 2-3 hour*; eurel 
practice with the *'Lietenin|^ In*' section » 1 hour; controlled oral practice 
("What would you say?"), 1 hour; free conversation, 1-2 hours. 
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favor of oral re^ading, paraphrasing, and question- and -answer 
based on the content. With the possible exception of some 
dictation from the reading- text, no writing in the language 
is done by the students throughout the sequence. On the 
assumption that writing ability is logically the l.ast ' and 
most difficult of the skills to develop, it is taught only 
in the advanced courses. 

Audio-visual aids were not used extensively during the 
first year of the program, for two reasons: (1) it was not a 
good year for the purchase of electronic recorders and 
similar devices, as technical improvements were being made so 
rapidly that successive makes of machines were quickly 
becoming obsolete; (2) dispersion of class sessions throu^out 
many buildings of the campus (a situation which was to 
be remedied by the fall of 1947) made even the use of phono- 
graphs difficult. However, toward the end of the year 
listening-rooms were set ip and many students availed them-* 
selves of the opportunity to listen (on their owi time) to the 
recordings of the basic text series, and in Gterman to some 
supplementary recordings cut by the local staff. 

The foreign- language requirement . Along with the re- 
organization of instruction, the language requirement for 
graduation^ was redefined in terms of proficiency rather than 
accrued course credits — in the words of the director, of 
"achievemient rather than endurance". The -level of achievement 
which actually constitutes proficiency is determined by the 
language staff on the basis of performance on standardized 
and other examinations. Theoretically any student may present 
himself for the proficiency examination at. any time it is 
administered, whether or not he has completed, the basic 
sequence of courses. In practice, such stude|it homogeneity 
prevails as regards language experience and competence that 
the bulk of the students present themselves for proficiency 

^Thia requirement nay be fulfil led in any one of the languagea taught. 
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at the end of the basic sequence, and at that time the majority 
of them are declared proficient. 

Placement. The bulk of the elementary-course enrollment 
naturally consists of students having no previous experience 
with the language in question. Students who have studied the 
language in high school take a placement examination which is 
identical with the examination used to determine proficiency. 
Oh the basis of their scores on this placement test they are 
(1) required to start in the elementary course®, (2) placed 
in the intermediate course, or (3) declared already proficient 
and permitted to enroll in an advanced course if they wish. 
A student placed in the elementary course may take the 
proficiency test again at the end of that course, or he may 
wait until he has completed the two-course sequence, the point 
at which most students take the proficiency examination. If at 
this stage he fails to perform at the proficiency level but 
still passes the course, he is required to study the language 
for one more semester, in a three-hour-per-week course designed 
chiefly to bring his reading ability up to an acceptable level 
of adiievement. He is required merely to pass this course, not 
to retake and pass the proficiency examination. It is felt 
that this arrangement encourages striving for proficiency 
because it rewards the superior student by early satisfaction 
of his language requirement and penalizes the dull or lazy 
student by requiring extra work. 

The desirability of using standardized measures for 
placement and proficiency determination led to the adoption, 
for this purpose, of the Co-t^erative Tests and the Investiga- 
tion’s Upper Level Aural Comprehension Tests. The resulting 
data was doubly useful, serving not only the present purposes 
of the Investigation, but also fulfilling an integral function 
within the new language program at College H. 



^In this situation they ere not deprived of their entrance credit in the 

language. 
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Testing data. Since each language was taught in accordance 
with the same principles and procedures, the presentation 
can be made according to major CQurse-groups each comprising 
students of the four languages in which our tests were 
available, namely, French, German, IRussian, and %>anish. The 
subdivision of elementary students into Groups la and lb, and 
that of intermediate students into Groups 2a and 2b, will be 
made clear as we proceed. Allotment of hours to the different 
phases of instruction was as follows: 









INTER. 


SEQUENCE 


1 


French 


EIVEMENTARY 


MEDIATE 


TOTAL 




75 


64 


139 


Oral-Aur«l Drill < 


German 


75 


45 


120 


Russian 


90 


60 


150 




Spanish 


65 


60 


125 




French 


0 


26 


26 


Reeding* • 


German 

Ihissian 


0 

0 


45 

30 


45 

30 




l^anish 


10 


30 


40 


Analysis Lectures j 


1 French, German, Spanish 45 

IRussian 30 


30 

30 


75 

60 



Groip la. These students took the elementary course in the 
first term of 1946“ 1947 and the intermediate course in the 
second term. The numbers completing the tv;o-year sequence 
were: French, 46; German, 113; Russian, 19; %>anish, 70^. 



•Th« foliowing texts were reed: French: PerScer end Grigeut, Initiation e 
{e culture frangaiee; Germaini: Klstner, Bail und die Deiektive end Geede end 
Klug, Geechiehten von Heute und Gee tern (by ell students); RKseler, Moderne 
Deuteche Bre^hler (by one third of the students); Russisn; Pergnent, 
Elementary ConVereat ional Buee ian Jleader ; Spnnish; Del Rio end Hespelt, 
Leeturae Biepinicae , Book I end Fernendes, Por Eeae Eepaliae. 



7|EnrollMent in the first tera wes lerger by about ISX. The attrition 
resulted froa three causes: ( 1 ) returning reterens were permitted to wsite 
certain required courses, end soae chose to waire coapletion of the language 
requireaent ; (2) students who had coapleted their language requirement in 
some other language were free to discontinue the present one; (3) soae 
students from other colleges then Arts and Sciences, haring no foreign 
language requireaent, also discontinued. Our data for Group la is based 
exclusirely on the continuing cases. “ 
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The results of the Co-operative and Aural test administra- 
tions in February and in June were as follows: 



CO-OPERATIVE 



AURAL 



French (N-^6) 





FEI. 


(1 YR , ) 


JUNE 


(2 YRS.) 




rEB. 


(1 YR.* 


JUNE 


(2 YRS.* 




ADV. n 


ADV. 0 




LOWER A 


UPPER A 




MEAN 


(«ILE> 


MEAN 


(«ILE) 




MEAN 


(TENTH* 


MEAN 


(TENTH 


R 


52.3 


(41) 


69.1 


(57) 


I 


8.0 


(9) 


12.0 


(7) 


V 


59.1 


(48) 


73.5 


(55) 


n 


15.1 


(8) 


17.8 


(5) 


G 


56. 4 


(59) 


63.9 


(61) 


M 


9.6 


(5) 


3.2 


(6) 


T 


56.5 


(49) 


70.6 


(58) 


T 


32.8 


(8) 


33.0 


(7) 










German 


II 












ADV. Q 


ADV. f 












R 


49.9 


(27) 


58.7 


(21) 


I 


6.9 


(6) 


6.5 


(5) 


V 


43.2 


( 8) 


59.5 


(21) 


n 


5.3 


(4) 


17.4 


(6) 


G 


55 . 5 


(61) 


58.4 


(33) 


HIT 


7.8 


(5) 


5.9 


(5) 


T 


49.8 


(29) 


59.7 


(22) 


T 


20.0 


(5) 


29.8 


(8) 










Spanish (N=70) 












ADV. 0 


ADV. P 












R 


55.3 


(56) 


66.1 


(51) 


I 


7.8 


(8) 


10.9 


(7) 


V 


52.8 


(38) 


60.7 


(27) 


n 


12.7 


(7) 


25.3 


(7) 


G 


50.6 


(42) 


64.0 


(56) 


m 


14.6 


(6) 


3.8 


(6) 


T 


53.7 


(46) 


65.0 


(44) 


T 


35.1 


(7) 


40.0 


(7) 










Ruetian (fhl9) 












DNVESTIGATION'S TEST 
















(TENTH* 




(TENTH* 












R 


5.2 


(1) 


20.5 


(6) 


I 


5.2 


(3) 


6.6 


(3) 


V 


5.2 


(1) 


16.6 


(7) 


n 


11.1 


(4) 


17.5 


(4) 


G 


12.9 


(4) 


21.1 


(7) 


M 


14.9 


(4) 


5.4 


(4) 


T 


23.3 


(1) 


58 . 2 


(6) 


T 


31.2 


(4) 


29.5 


(3) 



Observations on Co-operative scores. In February, the means 
of the total- scores for all groups were sub-median. By the end 
of the year those for French and Russian reached or exceeded 
the two-year norms, but those for German and Spanish fell 
short. Tlhe averages for Reading and Vocabulary show the same 
general trend. Grammar tended to be the strong point for all 
groups on both administrations. 
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Observation* on aural scores. In French and Spanish, \nhich 
according to the lower-level norms were more successful than 
German and Russian at the elementary stage, there is a tendency 
toward greater strength on Parts I and M (short items) than on 
Part m (anecdotes). All the aural practice material in the 
first half of the spoken language texts consists of short 
utterances, Mdiile only in the second half are a few anecdotes 
introduced. 

The comparative lowness of the Russian scores is due in 
part to the nature of the norm-distributions, which included 
(a) some groups of students more advanced than these, and (6) 
many students with Russian or related Slavic backgrounds. 

Previous experience of Group la students with the language 
studied. Eight French, ten German and eight Spanish members of 
Group la entered the elementary course in the fall having 
studied the particular language in high school, some of them 
as much as two years. They accordingly took the placement 
examination in October,® and the experience of coping with 
forms of the Co-operative and aural tests probably added to 
the advantage they enjoyed over the raw beginners when all 
were tested in February. Ihe following tabulation shows the 
differences (between the means of the total scores) by which 
the experienced students surpassed the inexperienced on the 
Co-operative and aural tests in February and in June: 

CO- OPERATI VE AURAL 





FEgRUARY 


JUNE 


FERRUARY 


JUNE 


French 


14.6 


1.8 


6.3 


2.4 


German 


B.8 


4.9 


4.9 


6.0 


Spaii ah 


12.6 


7.1 


14.4 


5.8 



In the reading skills, the students with previous experience 
were solidly enough grounded to maintain an apparent advantage 
over the novices throughout the two-year sequence in all 
languages, but none of the differences is significant by 

®Tlieir scores sre g^ren in Appendix B. 
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Jun^j, partly (though probably not wholly) because the subgroup 
theft took Upper Level Form A for the second time, the first 
time having been on placement in October. But for both typers 
of test, the numbers of students are too small for the results 
to be significant. In the field of oral production, on the 
other hand, although we have no objective data, it is reported 
that many of the students with previous experience remained 
inferior in pronunciation (though not necessarily in fluency) 
to many of the raw beginners whose speech habits were first 
formed through direct imitation of native speakers. 

Group lb. These students took the first-year course in the 
second term of 1946-1947 and were due to complete the sequence 
in the first term of 1947-1948. The numbers: French, 41; 
German, 106; Spanish, 61.^ 





CO-OPERATIVE 




AURAL 










French (N^Ul) 










JUNE (t 


YR. ) 




JUNE (t 


YR. ) 




ADV. 


R 




LOWER 


B 






MEAN 


(ftlLE) 




MEAN 




(TENTH) 


R 


57.8 


(62) 


I 


8.4 




(7) 


V 


60.9 


(56) 


1 


13.0 




(5) 


G 


58.7 


(68) 


IIW 


7.9 




(5) 


T 


60.8 


(67) 


T 


29.4 




(7) 








German (N-106) 










ADV . 


0 




LOWER 


A 




R 


49.7 


(29) 


I 


6.8 




(6) 


V 


44.2 


(10) 


II 


5.0 




(4) 


G 


57.1 


(67) 


TIT 


6.9 




(4) 


T 


50.2 


(30) 


T 


18.7 




(5) 






Spanish (N-61) 










ADV. 


0. 




LOWER 


B 




R 


53.2 


(47) 


I 


10.0 




(8) 


V 


50.3 


(30) 


1 


9.8 




(6) 


G 


45.3 


(23) 


Tnr 


9.1 




(2) 


T 


49.5 


(30) 


T 


28.9 




(5) 



^Elemeintary Russian was not giren in the “off" 



term. 
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Observations comparing these Group lb results with those of 
Group la at the end of one year: 

1. French results were slightly better on all parts of the 
Co-operative test and slightly poorer in aural comprehensicm. 

2. German Co-operative scores were approximately the same 
in each area (high only in Grammar); aural results were 
likewise the same. 

3. Spanish scores were distinctly poorer in Grammar, and 
in Phrt III (Anecdotes) of the aural test. 

Although the directors were striving to effect improvements 
on the basis of their experience, it is clear that the results 
attained did not correspond to their efforts. At least three 
considerations seem to affect this situation: (1) the interest 
and energy of tiring drill instructors tended to be directed 
more toward assuring the continuing success of the original 
Group la (then in its intermediate stage) than toward 
perfecting a second group of beginners in the same year; 

(2) fewer students in Group lb had studied the language 
previously, whereas in Group la such students contributed 
measurably to raising the average of the group as a whole; 

(3) Group lb contained some students for whom the elementary 
language course was mainly a six-credit filler in their 
second- term schedules; they did not propose to continue the 
language another year, and they were satisfied to meet iminiiiiiiim 
standards. 

Group 2a. These students took the second -year course in the 
first term of 1946-1947. The group was made up of (1) entering 
freshmen with an average of three years’ study of the language 
in high school, and (2) students who had already successfully 
completed one year of the language at College 

lOjPriYoloas •lectioms of an elementary language course are more likely 
occur in German or Spanish often as the secend foreign language studied « - 
than in French, the generally commonest first foreign language. 

l^For some, this ”one year*' had consisted of a concentrated elementary 
course of 90 hours during. the prerious summer at the rate of fourteen hours 

per week. 
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The results of the tests are given below, together with 
those of Group 2b. 

Group 2b. This small group of students took the second -year 
course in the second term of 1946-1947. In class they were 
amalgamated with Group la, from whom, however, they differed 
in that they had not taken the first -year course along with 
them, llieir background was identical with that of Group 2a, 
described above. Ihe results of testing Groups 2a and 2b are 
as follows: 





CO-OPERATIVE 






AURAL 










french 2a 


f/ik95) 








FES. (2 


YRS. ) 






FES. (2 


YR5.> 




AbV. 


Q 






UFFER 


S 




MEAN 


(%DLE) 






MEAN 


(TENTHl 


R 


69.8 


(60) 




I 


7.9 


(8) 


V 


75.3 


(62) 




M 


18.3 


(9) 


G 


66.9 


(72) 




Iff 


7.3 


(8) 


X 


72.9 


(66) 




X 


33.6 


(9) 








German 2a 










ADV. 


F 






UFFER 


A 


R 


62.3 


(32) 




1 


5.5 


(5) 


V 


62.2 


(29) 




1 


18.7 


(7) 


G 


61.6 


(47) 




wr 


6.4 


(6) 


T 


63. 1 


(34) 




T 


30.6 


(8) 








^anieh 2a 


(N^m) 


' 












UFFER 


■ 


R 


71.2 


(71) 




I 


11.7: 


(7) 


V 


68.8 


(58) 




I 


9.1 


(6) 


G 


70.5 


(79) 




Tfff 


5.4 


(4) 


T 


72.3 


(72) 




X 


26.2 


(7) 








French 2b 


(N=16) 








JUNE U 


YRS. ) 






JUNE (2 


YRS. ) 




ADV. 


O 






UPPER A 


R 


77.6 


(84) 




I 


13.7 


(8) 


V 


79.1 


(76) 




I 


20.8 


(7) 


G 


71.0 


(86) 




TUT 


5.0 


(8) 


T 


78.7 


(85) 




T 


39.5 


(8) 








German 2b 


(Ab24; 








ADV. 


F 










R 


62.7 


(34) 




I 


6.3 


(5) 


V 


63.5 


(34) 




K 


16.3 


(6) 


G 


60.8 


( 44 ) 




M 


6.0 


(5) 


T 


63.5 


(35) 




T 


28.6 


(7) 
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R 


70.8 


Spanish 

(70) 


26 (N=10) 
I 


11.7 


(7) 


V 


65.1 


(42) 


1 


24.7 


(7) 


G 


69.2 


(76) 


n 


2.4 


(3) 


T 


70.4 


(67) 


T 


38.8 


(7) 



In conparing the achievement of Groups 2a and 2b (students 
who entered the basic sequence at the intermediate level after 
I previous study of the language elsewhere) with that of Group 
i la (those who took the basic sequence from the beginning), we 
see: 

1* In French, Groups 2a-2b were strikingly better on all 
j the Co-operative scores and generally better on aural parts 
and total. 

2. In German, Group 2a-2b*s Co-operative scores were 
generally higher, though still sub-median in all areas; aural 
I results di ffered little. 

j 3. In Spanish, the Co-operative scores of Group 2a-2b were 

i decidedly better in every area, while in aural scores there 
was no difference. 



I High’-school versus college experience at the elementary 

I level in Group 2a. Thirty French, eighteen German, and twenty- 

1 four Spanish members of Group 2a entered the intermediate 

I course in the fail having studied the particular language in 
• high school. They accordingly took the placement examination 
in October^ ^ and may have been thereby prepared somewhat for 
facing the Co-operative and aural tests again at the end of the 



^^Their acorea on thia teat appear in Appendix B, aa do thoae of the few 
membera of Group 2b who took the placement examination in February. Studenta 
entering from a courae given previoualy at the college itaelf were not 
required to take the placement examination in October; a handful did take it 
in February. 
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term* The following tabulation shows the difference in total 
means by which the high-school-trained surpassed the college- 
trained subgroup on the Go-operative and aural tests at the end 
of the intermediate course in February: 





CO-OPERATIVE 


AURAL 


French 


5.2 


2.1 


German 


9.8 


16.3 


Spanish 


10 . 3 


5.7 






The high-school subgroup’s preparation for the intermediate 
course seems to have been superior in both the visual and 
the aural area. (In German, the high aural differential is 
partly due to the fact that the same form of the upper ~ level 
test was used both for the placement and in February.)/ 

Comparison with Conventional Groups 

A number of upper-class students at College H conpleted 
their language requirement by taking a conventional intermediate 
course given for the last time in the fall term of 1946-1947. 
The principal aims of the course, which met three hours per 
week, were reading ability and a review of grammar, with little 
stress on aural-oral achievement. Twenty-five French, forty- 
five German, and forty -three Spanish students taking the 
conventional course were tested by the Investigation in 
February. Their scores will be found in Appendix B. The 
following table lists the French, German, and Spanish Groups 
2a described above, which were completing the intermediate 
course under the new plan at the same. time. In the Co-operative 
and Aural colunms appear the differences in means between 
these Groups 2a and their ^conventional counterparts. A plus 
sign imeans that the difference favors Group 2a; a mdnus sign 
means that it favors the conventional group. 
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Differences between New-Plan Group 2a 
‘ and Conventional Groups 



CO-OPERATIVE 






AURAL 




2 YRS. 


French 




2 YRS. 


R 


+7.7 




I 


+ 1.5 


V 


+6. 1 




I 


+9.0 


G 


+4.5 




III 


+3.6 


T 


+6.7 


German 


T 


+14.2 


R 


+2. 5 




I 


+0.2 


V 


•K).8 




I 


+5.8 


VI 


+6.3 




n 


+0.2 


T 


+3.4 




T 


+6.2 


R 


+1.0 


Spanish 


I 


+ 1.5 


V 


-1.8 




I 


+1.6 


G 


-0.2 




11 


+0. 1 


T 


-0.2 




T 


+3.2 


While the 


differences 


mostly favor 


Group 2a, little weight 



can be attached to them because the conventional group 
constituted a heterogeneous mixture of irregular cases with 
varying amounts of previous experience and generally poor 
linguistic aptitude. 

Correlations 

Correlations were computed for all intensive groups taking 
(other than for placement) Lower or Upper Level Form A of the 
aural together with the Co-operative Test, in either February 
or June. The French and Spanish groups took Aural Form B in 
June, and are therefore excluded from the following figures: 

Lower- Level Aural and Co-operative Totals 

French (Group la, February): .59 

German (Group la, Feb., and lb, June): .50 

Spanish (Group la, February): .51 

Upper-Level Aural and Co-operative Totals^^ 

Fremch (Groups la and 2b, June): *64 

German (Groups 2a, Feb., and la and 2b, June): .40 
Spanish (Groups la and 2b, June): .16 

l^Correlations of part acc^res on these tests will be found in Appendix C. 
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These figures indicate that in experimental intensive 
courses aiming to develop both aural and visual skills on the 
assumption that the first contribute to the excellence of the 
second, correlations between outcomfis are no higher than in 
conventional courses in which reading is the chief objective 
and aural comprehension a secondary aim. Further data 
corroborating this observation will be encountered in our 
study of other experimental programs (e.g., College J). 
Summary 

Fundamental problems of teaching were not solved, nor 
crucial issues of learning settled, in the first year’s 
operation of the new plan at College M. Ch the basis of the 
1946-’1947 data alone we are not justified in appraising its 
present effectiveness and future potentialities. Ihe first 
steps of an operation as vast and complex as this were 
inevitably plagued by handicaps of every description. Ihe 
corps of native-speaking tutors was new and untried. With 
enrollment figures in the new scheme unpredictable up to the 
last minute, it was impossible to estimate the exact number 
of tutors needed, and as a result a few had to be hastily 
recruited from among native speakers available on the campus. 
In the future, enrollment figures will be known in advance 
and staff needs more readily estimated. Efficient instructors 
will be retained, and will resume work fortified by their past 
experience; time will permit a considered selection of 
replacements for those who were unsudcessful. During the first 
year a shortage of classroom space necessitated the assigning 
of offices and the scheduling of lectures and drill sections 
at widely scattered points on the campus. In 1947-1948 the 
entire foreign-language plant will be housed in a single 
building, which will facilitate (a) intercoimiunicatian between 
course directors and instructors, (b) co-ordination and 
improvement of classroom procedure through frequent observa- 
tional visits by course directors, (c) use of audio-visual 
equipment. 
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Ihe gradual overcoming of physical handicaps, with an 
attendant increase in efficiency of operation, should permit 
the staff to concentrate on inprovements of teaching technique 
leading directly to levels of performance higher than those 
reached during the first year. 'They know that in order to 
achieve that objective of high performance they need to work 
constantly to effect improveaients at the classroom level, 
and they know that improvements at the classroom level mean 
the selection and adoption (or the creation, if need be) of 
the finest possible textual materials, the effective utiliza- 
tion of audio=visual aids, and — most important of all — 
the continuing in-service training of teachers. 

College J 

In the fall of 1944 College J (a large privately endowed 
university) instituted a new Bachelor of Arts program 
characterized mainly by a fixed curriculum. The number of 
freshman students embarking upon this program was relatively 
small as compared to the total arts-college enrollment; it 
was therefore possible to establish, without great increases 
in staff, a semi -intensive experimental course in foreign 
language (French, German, or l^anish) for the entire new B.A. 
group. All language courses outside the B.A. program remained 
of the conventional type, and could thus serve as a control 
against which to measure the outcomes from the experimental 
courses. 

The experimental courses at College J roughly doubled the 
conventional amount of four contact hours per week prevailing 
in the basic -level courses. It was not intended, however, that 
the students should thereby reach or surpass the customary 
levels of performance in half as much time as the conventional 
groups. The primary justification of the increased contact 
rate was the notion that the traditional "home work" required 
of the students outside of class should be supplanted by 
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in-class drill work, i.e., frequent supervised practice in 
using the spoken language with the purpose of developing 
oral and aural skills. Outside preparation for the drill 
itself was generally not expected, and consequently the 
total amount of time devoted to the language was, theoretically 
at least, much the same in experimental as in conventional 
courses. 

In view of the very different natures of the two curricula 
in \idiich each language program was offered, it seemed possible 
that the quality of student might also be different. For 
exaiiple, the B.A. curriculum might tend to appeal to students 
of superior interest and ability in foreign languages, and 
such selective factors would, of course, invalidate comparisons 
between the achievements of the two language programs. 
Unfortunately, because of the heterogeneity of the B.S. 
curriculum and consequent scattering of the students* records 
through all the many divisions and schools of the university, 
it was impossible to secure the data for exact comparison of 
each experimental group with its conventional (B.S.) counter- 
part. Complete data for the B.A. students were obtainable. 
For the B.S. group, a random sample of equal size with the 
same representation of the languages was selected. 

Two bases of comparison were available i intelligence (as 
measured by the California Mental Abilities Test) and facility 
in the native language (as reflected by the grade in Freshman 
English, the only course commcn to students in boch curricula. 

For 1944-1945 the observable differences on both these 
scales favored the B.A. students, though not significantly. 
In 1945-1946 differences in the same direction were significant 
at the level for the Mental Abilities Test but not for the 
English grade. 

Another possible index seemed to be the grades assigned, to 
students in the different programs by the particular de- 
partments. In French during 1944-1945 the grades awarded to 
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the B.S. sections were slightly higher, though not signifi- 
cantly so, than those given to the B.A. students; in 1945-1946 
the equally slight trend was in the other direction. Ihe German 
Department awarded equal grades to both groups in 1944-1945, 
but in 1945-1946 it favored the B.A. students to the degree 
of the 5% level of significance. The Spanish Department 
favored the B.A. students slightly both years, but in neither 
case was the difference significant. 

For both groups in both years the mutual correlations 
between these three criteria (Mental Ability Score, English 
grade, and foreign language grade) are strikingly similar, with 
.38 being the median coefficient for most combinations. 

In short, the available evidence suggests that while the 
B.A. students in the experimental language program may have 
been slightly superior in 1945-1946, the differences are very 
small and that the groups compared in the following pages are 
probably equivalent in intelligence and linguistic facility. 

Ihe Investigation followed all first, second, and third year 
language courses, both experimental and conventional, through 
1944-1945 in two languages and through 1945-1946 in three 
languages; and experimental groups in two languages through 
1946-1947. All groups were tested with the Co-(^rative tests 
at the end of each quarter and were given the aural tests 
twice each year. In this chapter we report only the results 
obtained when both tests were administered simultaneously; the 
scores on the full battery of tests appear in Appendix B. 

We pioSv>nt the data by languages, as procedures varied 
somewhat from one to another. 

French 

Group ia. Seventeen B.A. students took the elementary 
experimental course in 1944-1945, and nine of them continued 
with the intermediate course the following year. In the first 
quarter of the first year, the language portion of their 
curriculum was devoted to a general course in linguistics 
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(entitled "The Nature of language"), conceived as preparatory 
ground-work for beginning the study of their particular second 
language in the second quarter (January). During the second 
and third quarters they met for lecture and drill ten hours 
per week for a total of 180 contact hours. Iheir principal 
textbook was Denoeu and Hall’s Spoken French, of the Meath 
Spoken Language series. Prescribed procedure in the use of 
this manual was followed: i.e., lectures dealt with the 
phonology, morphology, and syntax of French (with examples 
drawn from the material already assimilated) and with the 
phonograph records which reproduce the text utilized for 
illustration; drill work was devoted to mimirry and memoriza- 
tion of the basic sentences, aural practice listening to varia- 
tions of the basic matter, oral exercises of various types, and 
finally conversation practice in reproducing the situations 
treated. The lectures were given by the course director to 
the full class meeting together; for drill the students were 
divided into two groups, and the sessions were conducted by 
native or near-native instructors all of whom were regular 
members of the department staff and had had some classroom 
experience in teaching French. 

During the three quarters of the second year, Group la met 
eight hours per week^^ and accumulated a two-year total of 
390 hours. They worked principally with the text of a 
contemporary French play, Les Jours Heureux. The previous 
year, the director of the course had prepared a review analysis 
of French grammar, organized by structural categories but 
based exclusively on patterns occurring in the text and already 
familiar to the students when treated; this analysis, 
supplemented with exercises, constituted the material of the 
lectures. In the drill sessions the group read the play aloud, 
held conversations on its content, and dramatized certain 

hours per wsek wsrs dsrotsd to isoturs, six to drill. 

^^Four in lecture snd four in drill. 
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scenes with roles assigned and lines delivered from memory. 

The nine students in Group la who completed two years of 
French^ ^ produced the following tet nores: 



CO-OPERATIVE 





JUNE 


1t45 


DEC. 1*45 


JUNE 19 48 




1 


YR. 


1 YR. R 1 OU. 


2 YRS. 




ADV. 0 


ADV. R 


ADV. R 




MEAN 


(WILE) 


MEAN 


MEAN 


(RILE) 


R 


41.6 


(10) 


52.4 


65.8 


(45) 


V 


63.8 


(67) 


60.4 


66.1 


(25) 


G 


55.0 


(53) 


57.3 


61.6 


(50) 


T 


53.8 


(38) 


57.2 

AURAL 


66.0 


(39) 




JUNK 


: it 4 s 


DEC. tt4S 


JUNE )t46 




t 


YR. 


t YR. R t QU. 


Z YRS. 




LOWER A 


UPPER D 


UfRER A 




MEAN 


(fENTH) 


mean (tenth) 


MEAN 


(TENTH) 


I 


6.9 


(8) 


2.0 (2) 


11.3 


(6) 


M 


12.9 


(7) 


11.1 (5) 


18.2 


(5) 


mr 


15.3 


(8) 


7.3 (8) 


3.9 


(7) 


T 


35.1 


(8) 


20.4 (5) 


33.4 


(7) 



The Co-operative scores indicate that the group (a) did not 
learn to read at all adequately in one year and was still 
below the median at two years, (h) developed very respectable 
vocabulary for the one-year level but failed to increase that 
Vocabulary score very much in the second year, (c) acquired an 
average knowledge of grammar. 

The aural scores shew (a) very good performances at the end 
of one year, (6) average comprehension of the difficult 
upper-level material after only one quarter of the second 
year, particularly the dialogue section (taken, it will be 
recalled, from a play), and (c) a continuous development of 
aural ability through the second year. 

will bw reported below, the dranatiiation principle rather caaiially 
exploited in thie |rOiip becaiae the aainspring of an experiment with a 
■ubaequent group of French beginners. 

l^See Appendix B for scores from the original seventeen at one year. 
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Group lb. Inspired by his promising experiments in developing 
oral facility in French through the classroom use of a French 
play, the director conceived the plan of an introductory 
course which would exploit the full resources of dramatics in 
the teaching of French. He believed that the comsnon human 
liking for play-acting would lend motivation to some students 
in whom otherwise it might be lacking, and that the sense of 
taking part in a dramatic performance would bring some release 
from the self-consciousness which seems to inhibit many 
individuals’ atteirpts at oral production in a foreign language. 
He felt, however, that to be conclusive the experiment must 
be carried out under certain optimum conditions, which included 
(a) the use of a theater with a stage on which the students 
could act their productions, (6) some help in the techniques 
of staging, (c) specially prepared materials. CXir colleague’s 
search for these requisites was satisfactorily rewarded: 
(a) the university partially financed the conversion of a 
campus attic into a small theater; (6) a grant from a national 
foundation provided the aid of a dramatics coach as well as 
meeting the balance of the construction costs; (c) a member of 
the Investigation staff undertook to collaborate with the 
director in the production of the teaching materials. The 
course was inaugurated in the fall quarter of 1945. 

Twenty -five students were enrolled. Seven hours per week 
of their time was at the teaching staff ’s disposal.^* The 
normal distri’xition of these seven hours was three for lecture 
and four for drill. 

Ihe basic materials consisted of a series of eleven original 
skits, written by the Course director. The recurring dramatis 
personae of the Successive playlets are an American family 



ISFor the year 194S-1946» the B.A« curriculum was rtTiaed in such a way 
that elementary languafe students began their‘ particular language in the 
first quarter and met aewen hours each week throughout the yeari with an 
eighth hour per week dewoted to the general linguistics course which in the 
previous year had been completed in the first quarter* 
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visiting in Paris, and a French faimily who are their special 
friends and hosts. Each scene embodies some situation of 
French life an it might be experienced by foreign visitors. 
Thus in the first two scenes the Americans are greeted by 
their friends at the boat and go through the customs; in 
subsequent episodes they travel by train, find hotel ac- 
cominodat ions, eat at a restaurant, spend Christmas eve in 
their friends' home; the younger generation goes to the 
hairdresser * s,i partakes of French social life, attends a 
lycee. Ihe vocabulary of the skits is not wholly utilitarian; 
many specific terms occur which, it is true, are rarely heard 
outside of restaurants or beauty parlors; but also many common 
words and expressions are used by the characters as they 
converse which are transferable to alnost any life situation. 
No conce^ssion is made to simplification of vocabulary or 
idiom. The style is intended to be realistic, the tone 
sprightly and sophis^ticated; expressions occur which are 
vividly colloquial, some of them bordering on slang. 

The text of each skit was mimeographed in two columns, 
with an equally colloquial non-literal English version 
paralleling the French. The French version was not printed in 
normal French orthography at all: in each unit it appeared 
only in the form of a phonemic transcription, of which we 
reproduce a short sample from one skit; 

Boy: vwasil trSt&u, mldam. aprh Here's number 31, ladies. After 
YOU, silvoupie. you please. 

Mrs. R: sb-tiinbbl cMpbr, asd It’s a nice room-- quite large 

grid/f trh kl]^r. and very light. 



Boy: wi, madam, 4 vousave 18 Yes Ma'am; and you have running 

kouiXt, chd-d^ frwad, water, hot and cold, in this 

o lavaho isi. lavatory here. 



Marie: kkl rhbinV pourlA chM, <8 Which faucet is for the hot water, 
I'^khl pourlo f&wai:i? and which it for thp cold? 

Boy: j'^krwak-ah s'^lwi ag^h/pouf 16 (hesitating) I think it's the left 
frwad, m^ sh peu-t2L,tr/adrwat. one for cold, but maybe it's the 

right one. 
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Hiis transcription was deliberately devised to apply and test 
the theory that learners of French will acquire an authentic 
pronunciation of French if they are not too early confronted 
with its written form and thereby influenced by appearances 
before their habits of sound -production are fully formed. 
Such symbols as the ch and j were adc^ted in order to minimize 
the new steps involved later in approaching the regular 
spelling. Students using the Heath Spoken Fr'ench deal first 
with phonemic transcription but their transfer to normal 
spelling is begun after about 35 hours. The present group, 
on the other hand, saw no conventional written French whatever 
as l(»ig as they were learning and dramatizing their playlets, 
that is to say until about the middle of their third quarter. 
In preparing each skit they first heard the material spoken by 
their instructors and then imitated that spoken model; the 
transcription served as a useful and (for most persons) 
necessary visual aid during the basic aural process, and 
could later be consulted by the student as a completely 
reliable guide to the sequences of sounds, which it represented 
in one-to-one correlation with its symbols. 

The procedure enployed in working with the playlets was as 
follows. The group were brought together in a two-hour 
lecture period. Before they received their typed copies of 
the unit, their dramatics coach summarized its content in 
English. Next the staff of five instructors, augmented if 
necessary by one or two pre -trained members of the student 
group, presented the skit with full action and "props" on the 
stage while the students merely looked and listened. They then 
received the printed text; the coach explained the "business", 

some of which they noted down in the margin of their copy; 

% 

the scene was then repeated by the staff with the students 
following the text. The group then divided into four drill 
sections to prepare for their own presentation of the skit. 
TwO' weeks of drill, totaling eight hours, were spent in 
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learning and rehearsing a unit: six hours perfecting the 
lines, and two hours walking through the parts under the 
guidance of the coach. The drill practice consisted of 
miniicry-iineinorization, choral at first, and later individual 
as each student concentrated on his assigned role. Ihe 
culmination of two weeks* work was of course the final 
presentation of the skit by each of the Tour drill sections. 

Ihere is no doubt that the students enjoyed their "French 
in action" much more than a language course is normally 
enjoyed. Cutting classes was extremely rare, and every 
member of the group worked hard to perform at maximum capacity. 
Even as new roles were learned every two weeks, earlier ones 
were remembered without difficulty and previous Skits were 
frequently replayed on special occasions. With the. exception 
of one or two students who could neit:her imitate nor memorize 
the French lines and had to be dropped from the course, all 
members of the group acquired acceptable pronunciation and 
intonaticn, and the casual spectator at one of their presenter 
tions received the impression that these students really knew 
French. Actually, the French that they knew was limited 
strictly to the material of the skits. They could neither 
understand nor utter a single expression which did not occur 
verbatim somewhere within their script. Therein lay the 
weakness of the method, which could have been supplemented 
more fully than it was. 

0n‘ the theory that the students should understand the 
structure of the phrases they were uttering on the stage, a 
descriptive analysis of the material was issued to them in 
blocks covering several units at a time. This treatment was 
based strictly on the graiunBr of spoken French, in order that 
all forms or combinations of ' forms discussed could be 
illustrated in terns of the phonemic transcription. Supple- 
mentary exercises were provided in the form of short English 
expressions for >lyhich the French equivalent had to be arrived 




I 
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at analytically. Chiefly because of the relatively little 
class time devoted to this (two or three lecture hours at 
widely spaced intervals), the students failed to assimilate 
this new and unfamiliar kind of material satisfactorily. 

In addition to the grammatical analysis, shorter English 
versions of each skit were provided which introduced variations 
or twists not encountered in the original. These were designed 
to be rendered into French, without memorization or staging, 
for practice in varying the patterns of the principal versions. 
For the earlier units these variations involved mere trans- 
position of set phrases without internal change; later, after 
the analytical treatment had been studied, grammatical 
variations were introduced within the familiar utterances, 
such as changes of pronouns, of gender, and the like. The 
pressure of the memorized original patterns was so strong, 
and the students’ analytical grasp so slight, that they were 
unable to master this variation technique within the small 
portion of drill time set aside for it. 

A period of several weeks, beginning as soon as the eleven 
playlets had been perfected, was devoted to filming the entire 
series. This amateur film was intended to demoistrate some of 
the possibilities of similar movies which would be made by 
professional French actors. Since the films would show how 
each skit was to be staged and since their sound-tracks could 
serve as models for oral imitation, this dramatic technique 
of teaching elementary language could be used by teachers who 
did not have any of the rather elaborate facilities available 
to this experiment, the stage, the dramatics coach, and the 
corps of drill -masters. These and other possible values of the 
film are not germane to our interests here. The fact is 
pertinent, however, that the unprecedented amounts of time 
and energy which went into the process of shooting it 
contributed little to the students’ further acquisition of the 
linguistic skills. Consequently this movie project clearly 
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illustrates a point relevant to the consideration of many 
experimental courses: they were usually not limited to the 
rigid testing of the experimental procedures we are discussing 
here, but also incorporated various theories and interests of 
the local staffs, which sometimes involved work not directly 
related to the major purposes of the course. As a result, the 
present experimental programs are often far from demonstrating 
the maximum effect obtainable from the concentrated and 
efficient use of- the basic procedures employed. 

When, after the filming, normalcy was restored to the 
course, what remained of the third quarter was used for 
teaching the students conventional French orthography and 
introducing them to reading. Ihe spelling was taught by means 
of regularly written texts of the playlets, so that the 
printed symbols could be related to familiar sequences of 
sound firmly implanted in the students* auditory consciousness. 
While no objective data are available on the effectiveness of 
the late transfer, observers believe that all but the poorest 
students mastered the essentials of regular spelling with 
relative ease and that few of the group found their established 
speech habits altered by the appearance of the written language. 

In their initiation to reading the group studied the French 
version of Wendell Willkie*s One World (Le monde est wi). Very 
little was covered before the end of the first year, but the 
book was continued and finished in the second year. Instead 
of the conventional vocabulary or dictionary, the E'^^glish 
version itself was used for guidance and reference. Ihe 
objective was direct mastery of French literary vocabulary and 
expression rather than translation or structural analysis. 
At the same time seven contact hours per week afforded the 
students continuous opportunity to extend the scope of their 
oral production and aural comprehension well beyond the 
limits of the original playlets which had laid the foundaticn 
of these skills. After completing the Willkie they went on to 
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other readings, and studied a conventional gramnnar of written 
French, to complete their second year. 

The group was tested by the Investigation, along with all 
other groups, at the end of their first year and twice in 
their second year. After the first-year dramatics course they 
were not expected to conpare favorably with any other group, 
since their one special skill was not measurable by either of 
the standard tests. We report their first-year scores in 
order to show the progress made during the second year: 



CO-OPERATIVE 





JVHE 


1949 


MAR. 1947 


JUNE 


1947 






tTR. 1 


YR. ft Z QU. 


2 YRS. 




ADV. n 


ADV. 0 


ADV. 


Q 




MEAN 


(%ILE) 


MEAN 


MEAN 


(%DLE) 


R 


29.0 


(0) 


53.7 


70.5 


(63) 


V 


53.4 


(26) 


69.3 


75.6 


(63) 


G 


46.1 


(19) 


55.9 


67.0 


(73) 


T 


42.2 


(7) 


60.5 
AURAL ' 


73.2 


(67) 




JUNE 


1948 


MAR. 1947 


JUNE 


(9 47 




t 


YR. t 


YR. ft 2 QU. 


2 YRS. 




LOWER A 


UPPER B 


URPER A 




MEAN 


( TENTHl 


mean (TENTH) 


MEAN 


( TENTH) 


I 


4.1 


(5) 


9.5 (9) 


11.9 


(7) 


1 


11.5 


(5) 


16.8 (8) 


21.6 


(8) 


Hi 


4.8 


(2) 


6.4 (7) 


5.1 


(8) 


T 


20.4 


(4) 


32.7 (9) 


38.6 


(8) 



Ihe Co-operative scores indicate steady progress, through 
the second year, from almost no reading ability whatever to a 
better-than-average, well-balanced control of all three areas 
measured by the test. 

The first -year aural scores are at the median on Parts" I 
and II, but the expected inability to comprehend anecdotes 
is confirmed by the Part III score. In the second year, 
however, aural performance is consistently high. 

Both sets of second-year scores contrast so fayorably 
with the first-year scores as to suggest that the group’s 
highly developed skill in acting skits, although nothing 
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measuirable by the tests themnselves , nevertheless .constituted 
an excellent foundation on which a larger body of skills was 
rapidly and efficiently built. 

Group Ic. The elementary French experimental group of 
1946-1947, numbering twenty-eight, was divided evenly into 
two groups to be taught independently oi each other by 
different methods. Both operated on seven-hour -per -week 
schedules throughout the year. 

Subgroup Ic.l took the same dramatics course as Group lb 
the preceding year. In view of the regular teaching staff’s 
previous experience with the course, the services of the 
dramatics coach were dispensed with, but otherwise the 
procedure was essentially unchanged. However, no movie was 
made, and thereby nearly a full quarter’s time was. saved in 
which more use was made of the analytical and supplementary 
materials, transition to normal orthography was effected 
earlier, and more reading was. done. 

Subgroup lc.2 used as their basic material Harris and 
h6\i(jae* s Conversational French, a newly published textbook 
developed from conversational materials first produced in 
comection with a semi -intensive experimental course at the 
beginning level. 

Both subgroups were tested at the end of the second and 
third quarters, with the following results; 

CO-OPERATIVE AURAL : 

Subgroup ic. i 





MARCH 19 47 


JUNE 1t47 




MARCH 19 47 


JUNE 


1947 




2 QU. 


1 


1 YN. 




2 


QU. 


1 


YR. 




ADV, 0 


ADV. Q 




LOWER B 


LOWER A 




MEAN 


MEAN 


(«it.E) 




MEAN 


{ TENTH) 


MEAN 


( TENTH) 


R 


36. 1 


50.2 


(33) 


I 


*6.7. 


(6) 


6.7 


(8) 


V 


63.6 


68.6 


(83) 


H 


16.4 


(7) 


16.4 


(8) 


G 


47.4 


57.4 


(63) 


IT 


6.5 


(4) 


14.0 


(8) 


T 


48.9 


59.6 


(61) 


T 


29.6 


(7) 


37.1 


(8) 








Subgroup 1 


c. 2 










R 


47.5 


56.9 


(59) 


I 


'9.9 


(8) 


7.8 


(9) 


V 


62.8 


68.2 


(62) 


n 


16.1 


(7) 


17.7 


(8) 


G 


58.4 


' 66. 8 


(91) 


m 


8.1 


(5) 


13.9 


(8) 


T 


56.7 


65.4 


(81) 


T 


34. 1 


(8) 


39.4 


(8) 



liiiii 



■diiiijgi 
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Both the Co-operative and the aural scores of Subgroup Ic.l 
are much higher than those of Groi^ lb at the same stage, thus 
indicating the effect of increased efficiency, reduced waste 
of time and energy, and strengthened transition to reading the 
second year the course was given. 

At the same time the scores of Subgroup lc.2 run generally 
higher than those of Ic.l, especially, in Reading and Grammar. 
Use of the Conversational french thus brought the students 
to a higher level of general one-year achievement than did 
the dramatics materials; but in view of the rapid general 
progress made by Group lb during the second year, it is 
impossible to judge the relative solidness of these one-year 
foundations without second-year data on both subgroups. 

Group 2a. This was a group of eleven freshmen entering the 
B.A. program in the fall of 1944 with previous high-school 
study of French. During the first quarter they took the 
general linguistics course, and in the' second quarter began 
an intermediate experimental French course meeting eight 
hours per week for a total of 140 hours over and above their 
previous high-s%..hooi study. This was the course based 
principally on work with the play Les Jours Heureux, as 
described above in connection with Group la’s second -year 
course (1945-1946), and its? first trial was with this group 
in 1944-1945. 

In 1945-1946 Group 2a took an advanced course meeting eight 
hours per week in the first quarter and five hours per week 
thereafter for a running total of 300 college hours. The 
results of their testing over the two-year period are as 
follows: 
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CO-OPERATIVE 





JUNE 


1945 


DEC. tt45 


JUNE 


1945 




2 YRS. 


2 YRS. A t QU. 


3 YRS. 




ADV. 


, 0 


ADV. R 


ADV. 


R 




MEAN 


(%ILE) 


MEAN 


MEAN 


(KILE) 


R 


73.3 


(73) 


86.4 


86.8 


(88) 


V 


78.1 


(73) 


78.8 


01.4 


(50) 


G 


71.5 


(87) 


67.5 


74.0 


(83) 


T 


76.3 


(78) 


82.5 


83.9 


(78) 








AURAL 








DEC. 


t94S* 




JUNE 


I94« 




2 YRS. 


A t QU. 




3 YRS. 




UPPER B 




UPPER A 




MEAN 


(TENTH) 




MEAN 


( TENTH) 


I 


10.0 


(6) 




17.5 


(7) 


1 


n.o 


(5) 




29.3 


(7) 


n 


9.0 


(7) 




6.7 


(6) 


T 


36.0 


(7) 




53.5 


(8) 



*Not tested eurelly in June 194S. 



Group 2a shows far higher Co-of)erative scores than Group la 
at the same stage (see p. 181). The difference is significant 
at the 5^ level, >ind doubtless means that this group's 
high-school training had formed a solider basis for the 
development of the visual skills than Group la was able to 
establish in its elementary (experimental) course. 

In the aural scores, there is no satisfactory point for 
comparison between Groups 2a and la. 

Groups 2b and 2c. These groups of eight and six students 
entered the B.A. program as freshmen in the falls of 1945 and 
1946 respectively. They took the same intermediate experimental 
course as Group 2a, but began in the first quarter at seven 
hours per week (taking one hour of linguistics concurrently). 
Over and above their high-school study they thus accumulated 
180 hours at the end of the year, slightly more than Group 
2a 's 140 hours. 
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We did not follow Group 2b and 2c into their third 
(advanced) year. Iheir scares for the intermediate year are 
atj follows: 



CO-GPERATIVE 








AURAL 










Group 


26 










DEC. t»4S 


JUNE 


1948 




DEC. 


1C45 


JUNE 


19 48 


1 YR. ft t QU. 


2 YRS. 




t YR. ft 


1 QU. 


2 YRS. 


ADV. R 


ADV 


. R 




UPPER 8 


UPPER A 


MEAN 


MEAN 


(«1LE) 




MEAN 


( TENTH) 


MEAN 


( TENTH) 


H 77.4 


88.2 


(98) 


I 


6.1 


(6) 


13.1 


(7) 


V 74.8 


77.1 


(69) 


1. 


16.5 


(8) 


20.8 


(7) 


G 72.5 


69.8 


(81) 


TW 


6. 1 


(7) 


5.2 


(8) 


T 77.6 


8i. 1 


(90) 


T 


28.7 


(8) 


39.1 


(8) 






Group 2c 












MARCH 1947 


JUNE 


1947 




MARCH 


J947 


JUNE 


19 47 


1 YR. at 2 QU. 


2 YRS. 




t YR. ft 


2 QU. 


2 YRS* 


ADV. 0 


ADV 


. 0 












MEAN 


MEAN 


(VJLE) 




MEAN 


( TENTH) 


MEAN 


( TENTH) 


R 63.7 


75.8 


(80) 


I 


10.7 


(9) 


14.2 


(8) 


V -73.2 


78.8 


(76) 


M 


20.0 


(9) 


16.7 


(5) 


G 65.7 


68.7 


(80) 


HE 


9.0 


(9) 


6.7 


(9) 


T 68.7 


77.0 


(80) 


T 


39.7 


(9) 


37.5 


(8) 



I. 

These high-school trained groups join with Group 2a in 
significantly surpassing college -trained Group la at the 
two-year stage in the reading skills. We also find here aural 
comparisons with Group la (not available for 2a), but in this 
field the difference favoring the present groups is not 
significant. 



Comparison with Conventional Groups (French) 

We tested all conventional French classes at College J in 
1944-1945. and 1945-1946:» but none in 1946-1947. , Ihese courses 
met four hours per week in the first two ye«irs for totals of 
105 hours per year, and three hours per week in the third year 
for a total of 80 hours, bringing the three -year accuniilation 
to 290 hours. As stated above, however, it will not be 
pertinent to contpare experimental and conventional groups at 
comparable levels in terms of accumulated hours. Ihe announced 
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purpose of the experimental courses was not to attain the 
same goals in the same number of hours, but to reach a 
comparable level of reading skill and higher levels of oral- 
aural skill in the same number of years, through the device 
of converting unsupervised outside study into directed 
practice with the spoken form of the language. It is therefore 
on equality of calendar time that we base our comparisons 
between the experimental and the conventional groups. 

We do not give scores of conventional groups in this 
section; all are contained in Appendix B. The table which 
follows lists the four experimental groups of 1944-1945 
and 1945-1946 described above, with separate columns for the 
successive Co-operative and aural testings. In each of these 
columns appears the difference in the means between the 
experimental group and its conventional counterpart on the 
same test at the same calendar stage. A plus sign before the 
difference indicates that it favors the experimental group; a 
minus sign indicates that it favors the conventional group. 
At the final testing, the symbol ^ or ® appearing after the 
difference indicates that it is significant at the 1% or the 
5% level as the case may be. 

In reading skills, the college-trained experimental Group 
la was significantly poorer than its conventional counterpart 
even at the end of two years. On the other hand the inter- 
mediate experimental groups 2a and 2b, previously trained in 
high school, were not significantly different from the 
corresponding conventional groups at two years or at three 
years. 

In aural comprehension, only one experimental group out of 
four was significantly better than its conventional counter- 
part — namely Group 2a at three years. Nevertheless with the 
exception of Group lb, which is to be considered a special 
case, the other (non-significant) aural differences consis- 
tently favor the experimental groups. 
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TABIJE XI 

Differences between Means for Experimental 





and Conventional Groins 


— French 




CO-OPERATIVE 


AURAL 




Group la 


1 YR. 


2 YRS. 1 YR. 


t YR. ft t QU. 


2 YRS. 


R 


-17.8 


-13.3 ]: 


-2.6 


+0.9 


■'! V 


- 4.3 


- 7.1 1 


+2.5 


-0.3 


G 


-10.6 


- 6.1 m 


+3.1 


+0.5 


;l T 


-11.3 


- 9.35 T 


+3.0 


+1.1 


l! 

Group lb 


1 YR. 


2 YPS. t YR. 


t YR. ft t OU. 


2 YRS. 


R 


-28.7 


I -1.7 






V 


- 8.5 


I -2.1 






G 


-12.7 


II -4.1 






T 


-18.2* 


• T -7.9 


* 


* 


Group 2a 


2 YRS. 


3 YRS. 2 YRS. 


2 YRS. ft 1 qu. 


3 YRS. 


R 


-0.8 


-4.2 


+2.3 


+4.3 


V 


-1.3 


-0.7 


+1.1 


+8.2 


G 


+2.7 


+1.9 


+1.9 


+1.8 


T* 


-0.2 


-1.0 i 


+5.3 


+ 14.35 


Group 2b 


2 YRS. 




1 YR. ft I QU. 


2 YRS. 


R 


+9.6 


I 


+1.1 


+2.7 


V 


+1. 8 


I 


+6.1 


+3.2 


G 


+1.1 




+1.8 


+1.6 


T 


H. 4 


T ■ 


+11.0 


+7.5 



Conyentional group not teoted. 

^Neither group tested. 

j; 

There is not in these figures a strongly:; enough defined 
pattern to indicate decisively that the French experitnental 
program as a whole did or did not achieve its announced 
objectives. 

Spanish 

Group la. Ihis group of seventeen B. A. students took the 
elementary experimental course in 1944-1945, and nine of them 
continued with the intermediate course the following year. 
Like the corresponding French Group la (and for' the same 
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reason: see p. 180) they began Spanish in the second v^uarter 
and met for lecture and drill eignt hours per week for a 
total of 180 contact hours. Their principal textbook was 
Krakeur’s Las Aventuras de Roberto Martin, the Decca Language 
Series method with accompanying phonograph records reproducing 
the text. Much supplementary material in mimeographed form 
was also used. Lectures by the course director to the full 
group dealt with the linguistic structure of Spanish, with 
the phonograph records used for illustration of the phonology; 
drill work was devoted to mimicry and memorization of the 
text — a mystery story with background circumstances selected 
from the usual stock of travel, food, sport and amusement 
situations — and to practice ^with a number of supplementary 
exercises, based on that text, which the course director 
himself produced. The group was split into two sections for 
the drill work, which was conducted by Latin Americans 
attending the university in one or another capacity, who were 
not by profession teachers of Spanish. These drill-masters 
rotated from one to the other drill section every other week, 
in order that the students might accustom themselves to 
hearing more than one native speaker’s voice and accent. 

During the three quarters of the second year Group la met 
seven hours per week^O and accumulated a two-year total of 390 
hours. They worked principally with Tyre’s Speaking Spanish, 
supplemented by mimeographed materials. 

The nine students in Group la who completed two years of 
Spanish21 produced the following test scores: 



^^Three hours per week were devoted to lecture, five to drill# 

2®T]liree in lecture and four in drill. 

21See Appendix B for scores from the original seventeen at one year. 
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CO-OPERATIVE 





JUNE 


1945 


DEC. 1945 


JUNE 


19 46 




\ YR. 1 


YR. & 1 QU. 


2 YRS. 




ADV. 


0 


ADV. 0 


ADV 


. 0 




MEAN 


( %l LE) 


MEAN 


MEAN 


(%ILE) 


R 


60.6 


(76) 


64.0 


70.6 


(69) 


V 


54.8 


(47) 


56.6 


65.9 


(46) 


G 


40.7 


(11) 


49.9 


61.6 


(46) 


T 


52.3 


(41) 


57.8 


67.6 


( 55) 








AURAL 








DEC . 


t94S* 




JUNE 


19 46 




I YR. a 


t QU. 




2 YRS. 




UfPER B 




UPPER A 




MEAN 


(TENTH) 




MEAN 


( TENTH) 


I 


13.1 


(8) 




15.2 


(9) 


1 


13.0 


(8) 




26.1 


(7) 


u 


4.4 


(3) 


a 


5.4 


(6) 


T 


30.5 


(7) 




46.7 


(8) 



*Not tested aurally in June 1945. 



The Co-operative scores indicate that the group (a) was 
adequate in Heading at the end of one year and maintained 
its level in the second yearj (6) stoiod slightly below the 
median in Vocabulary in both years; (c) was very weak in 
Grammar at one year but progressed nearly to the median in 
the second year. 

The aural scores show (a) excellent comprehension of . the 
difficult upper-level material after only one quarter of the 
second year, except on the Dialogue (in which respect cf. 
French Group la), and (6) development of hi^ aural competence 
in the second year. 

Group lb. This was the 1945-1946 counterpart of Spanish 
Group la, made up of twenty-five entering B.A. freshmen. 
Materials and procedure in both the first and the second year 
were the same as for Group la, but on the revised basis of 
seven hours per week throughout both years, divided into 3 

^^See Footnote 18. page 182. 
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of lecture and 4 of drill. The test results from this , group 
were as follows: 



JUNE lt4« 
t YR. 

ADV. 0 

MEAN (%ILE> 

R 59.8 (73) 

V 53.7 (41) 

G 56.3 (66) 

T 57.4 (62) 



JUNE t94« 
t YR. 

LOWER A 

MEAN (TENTH) 

I 8.4 (8) 

I 12.4 (6) 

M 14.5 (6) 

T 35.3 (7) 



CO-OPERATIVE 

DEC. 194« 

I YR. a t QU. 
ADV . 0 

MEAN 

64.3 

56.7 

63.7 

62.8 
AURAL 

DEC. t946 
;I YR . a t QU. 
UPPER B 

MEAN (TENTH) 

11.7 (8) 

8.8 ( 6 ) 

7.7 (7) 

28.2 (7) 



JUNE 1947 
2 YRS. 



ADV. 


0 


mean 


(%ILE) 


68.9 


(63) 


66.9 


(50) 


67.3 


(69) 


69.6 


(63) 


JUNE 


(9 47 


2 YRS. 


UPPER A 


MEAN 


( TENTH) 


11.2 


(6) 


23.5 


(6) 


6.2 


(7) 


40.9 


(7) 



As contrasted with Group la, this group learned grammar 
adequately in the first year, and its Vocabulary and Grammar 
levels were higher at the end of two years, dropping nowhere 
below the median. 

Group lb*s aural ability, we 11 -developed at one year, 
reinained consistent but was one decile lower than that of 
Group la at the end of two years. 

Group: Ic. The elementary Spanish experimental group of 
1946-1947, numbering twenty-seven, did not differ in respect 
to method or time -schedule from Group lb of the preceding 
year. Ihe results of March and June testings were as follows: 

CO-OPERATIVE , . AURAL 





MARCH (947 


JUNE 


n47 




MARCH 


m 7 


JUNE 


H947 




2 QU. 


fl YR. 




2 QU 


• 


1 YR. 




ADV. Q 


ADV. 


0 




LOWER 


B 


LOWER A 




l>.ilEAN 


MEAN 


(%1 LE) 




MEAN (TENTH) 


MEAN 


( TENTH) 


R 


56.7 


63.3 


(84) 


I 


11.9 


(9) 


8.2 


(8) 


V 


53.2 


54.1 


(43) 


1 


14.5 


(8) 


12.0 


(6) 


G 


49.8 


56.1 


(65) 


M 


14.7 


(5) 


15.0 


(6) 


T 


53.7 


58.9 


(68) 


X 


41.1 


(8) 


35.2 


(7) 
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Group Ic, weakest in Vocabulary just as Group lb, surpassed 
the latter group in Reading and Vocabulary, and matched it in 
Grammar, at one year. Ob the aural test. Group Ic’s one -year 
scores are almost identical, part for part, with those of 
Group lb. Ihe drop from 8th to 7th tenth from March to June is 
probably due merely to the difference of forms and does not 
represent a regression in aural competence. 

The observable rise in performance level on the Co-operative 
tests by the three successive first-year groups, without a 
compensatory drop in the aural scores, suggests that the 
experimental method was successfully perfected in the achieve- 
ment of reading and grammar objectives as the teaching staff 
gained experience. 

Group 2a. This was a group of twenty-three freshmen 
entering the B.A. program in the fall of 1944 with previous 
high-school study of Spanish. During the first quarter they 
took the general linguistics course, and in the second quarter 
began the same intermediate Spanish course already outlined as 
taken by Groups la and lb in their second year, but meeting 
eight hours per week for a total of 140 hours over and above 
their previous high -school study. 

In 1945-1946 thirteen of the original twenty-three continued 
Spanish by taking an advanced course meeting eight hours per 
week in the first quarter and five' hours per week thereafter 
for a running total of 300 college hours. The results of 
testing the thirteen continuing students over the two-year 
period are as follows: 



QO-OPERATIVE 





JUNE 


1945 


DEC. 1945 


JUNE 


1946 




2 YRS. 


2 YRS. ft t QU. 


3 YRS. 




ADV. 


0 


ADV. 0 


ADV. 


0 




MEAN 


(%0 LE) 


MEAN 


MEAN 


(y.i LE) 


R 


76.2 


(87) 


84.0 


80.3 


(76) 


V 


76.1 


(82) 


78.3 


82.4 


(75) 


G 


64.1 


(56) 


64.6 


73.8 


(76) 


T 


74.0 


(79) 


76.7 


81.5 


(79) 
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AURAL 

JUNE 1945 DEC. 1945 JUNE 1946 

Z YRS. 2 YRS. a 1 OU. 3 YRS. 

UPRER A UPPER B UPPER A 





MEAN 


( TENTH) 


MEAN 


( TENTH) 


MEAN 


(TENTH 


I 


17.2 


(9) 


14.3 


(5) 


19.2 


(9) 


H 


31.1 


(9) 


13.7 


(5) 


32.3 


(9) 


M 


7.2 


(8) 


8.2 


(4) 


:.i 


(9) 


T 


55.5 


(9) 


36.2 


(5) 


59.2 


(9) 



Group 2a shows considerably higher Co-operative scores than 
Groups la and lb at the same stage (see pp. 196-197). This dif- 
ference, although not significant, suggests as in the case of 
French that high-school training may have, furnished a solider 
basis for the development of the reading skills than the 
college groups had been able to establish in their elementary 
(experimental) course. 

As for the aural scores, this group was one decile higher 
at two years than Group la, and two deciles higher than Group 
lb, but the- differences are non-significant. The drop from the 
9th, to the 5th tenth of the upper -level test between June and 
December 1945 is difficult to explain, although it is, doubtless 
partially attributable to the; difference of forms. 

Group$ 26 and 2c. These groups of twenty-seven and thirty- 
eight students entered the B. A. program as freshmen in the 
falls of 1945 and, 1946 respectively. They took the same 
intermediate experimental course as (jroup 2a, but began in the 
first quarter at seven hours per week. Over and above their 
high-school study they thus, accumulated 180 hours at the end 
of the year, slightly more than Group 2a *s 140 hours. Except 
as stated below, we did not follow Groups 2b and 2c into their 
third (advanced) year. Their scores for the intermediate year: 
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CO-OPERATIVE AURAL 

Group 2b 



DEC. 1945 


JUNE 


1946 




DEC. 


1945 


JUNE 


1946 


t YR. at t OU. 


2 YRS. 




t YR. ft 


1 QU. 


2 YRS. 




ADV. 0 


ADV. 0 




UPPER B 


UPPER A 




MEAN 


ItCEAN 


(%9LE) 




MEAN 


(TENTH) 


MEAN 


(TENTH) 


R 


68.2 


72.2 


(75) 


I 


10.8 


(5) 


15.2 


(9) 


V 


67.6 


73.4 


(74) 


s 


9.8 


(7) 


27.7 


(8) 


G 


61.0 


70.9 


(81) 


H 


8.2 


(7) 


4. 1 


(5) 


T 


67.2 


74.2 


(80) 


X 


28.8 


(7) 


47.0 


(8) 








Group 2 












DEC. 1945 


JUNE 


1947 




DEC, 


1946 


JUNE 


1947 


t YR. ft I QU. 


2 YRS. 




5 YR. ft 


1 QU. 


2 YRS. 




ADV. 0 


ADV 


. 0 




UPPER 


B 


UPPER A 




MEAN 


MEAN 


(«I LE) 




MEAN (tenth) 


MEAN 


(TENTH) 


R 


70.8 


74.1 


(80) 


1 


12.0 


(8) 


15.3 


(9) 


V 


67.0 


73.5 


(75) 


I 


11.3 


(7) 


26.1 


(7) 


G 


67.6 


69.8 


(78) 


M 


7.7 


(7) 


6.9 


(8) 


T 


70.4 


74.6 


(80) 


T 


31.0 


(7) 


48.3 


(9) 



These high=school trained groups join with Group 2a in 
surpassing college-trained Groups la and lb at the two-year 
stage on the Co-operative tests, but these differences and 
those on the aural are non-significant. 

Twelve of the twenty-seven members of Group 2b continued 
with the advanced course in 1946-1947, and were tested^ aurally 
once during that year, but not visually. Their scores- on Aural 
Upper B in December 1946 (at 2 yrs. and 1 qpu.) were: 





MEAN 


(TENTH) 


. I 


15.3 


(5) 


I 


15.9 


(6) 


n 


9.1 


(5) 


T 


40.3 


(6) 



Comparison with Conventional Groups (Spanish) 

As in the case of French, we tested all conventional Spanish 
classes at College J in 1944-1945 and 1945-1946, but none in 
1946-1947. The total number of hours accumulated by these 
Spanish classes was the same as in French (see p. 192). However, 
for the reasons stated above in connection with French (see 
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p. 193), we compare the experimental and conventional groups 
only on the basis of equal calendar time. 

Actual scores of conventional Spanish groups are found in 
Appendix B. Ihe following table lists the four experimental 
groups of 1944‘'194S and 1945~1946 described above, with 
differences in the Co-operative and aural be':ween the experi- 
mental group and its conventional counterpart on the same test 
at the same calendar stage. 



TABLE XII 

Differences between Means for Experimental 
and Conventional Groups — Danish 







00- OPERATIVE 








AURAl. 






Group 


la 




t YR. 


2 YRS. 




t YR. 


1 YR. a t 


QU. 


2 YRS. 






R 


-2.2 


-1.6 


I 




+5.2 




+6.0 






V 


-7.0 


-8.0 


JJ 




+5.6 




+1.8 






G 


-IS. s 


-7.3 


m 




-1.4 




+0.7 






T 


-8.9 


-6.25 


T 


4 


+9.4 




+8.5 


Group 


lb 


R 


1 YR. 

-5.0 


2 YRS. 


I 


I YR. 

+2.4 


t YR. a t 


QUs 


2 YRS. 






V 


-7.4 




I 


40.4 












G 


-6.3 




M 


,40.7 












T 


-6.8l 


* 


T 


+3.5 


* 




* 


Group 


2a 


R 


2 YRS. 
-2.6 


3 YRS. 

+1.7 


I 


2 YRS. 


2 YRS. a t 

+1.4 


QU. 


3 YRS. 

+4.0 






V 


-5.6 


-2.9 


M 




40.4 




+3.1 






G 


-0.9 


-0.4 


imr 




+1.4 




+2.2 






T 


-3.6 


-0.7 


T 


* 


+3.2 




49.3 


Group 


2b 




2 YRS. 


3 YRS. 






1 YR. a t 




2 YRS. 






R 


40.9 




I 




+4.3 




+5.2 






V 


-0.6 




I 




+3.8 




+4.4 






G 


+2.8 




IM' 




+2.3 




-0.1 






X 


+1.0 




T 




+10.4 




+9.5^ 



^ConTemtionai group not tasted. 
^Neither group tested. 



?3por full explanation of the figures see that for the corresponding 
French table, p. 193. 
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In reading skills, the col lege -trained experimental Group 
la was significantly poorer than its conventional counterpart 
even at the end of two years, as was also Group lb at the end 
of one year. On the other hand the intermediate experimental 
Groups 2a and 2b, previously trained in hig^ school, were not 
significantly different from the corresponding conventional 
groups at two years or at three years. 

In aural comprehension, only one experimental group out of 
four was significantly better than its conventional counter- 
part — namely Group 2b at two years. Nevertheless the other 
(non-significant) differences tend to favor the experimental 
groups by small margins. 

The pattern in these figures is strikingly similar to that 
of the French comparisons between experimental and conventional 
groups, and like the French pattern it does not shed strong 
light on the success of the Spanish experimental program as a 
whole. 

German 

German groups were followed by the Investigation only 
through the year 1945-1946. The German staff worked from the 
beginning of experimentation to develop an integrated two-year 
program with a three -fold purpose, involving the attainment 
of: (1) a reading knowledge for the effective use of German in 
connection with various fields of learning, (2) reasonable 
competence in aural comprehension and oral production of. the 
language, (3) some acquaintance with the background and 
culture of the German people. The textual material for the 
two-year course was prepared by the staff. 

Group 1. Sixteen freshmen entering the B.A. program in the 
fall of 1945 wer^ enrolled in the elementary experimental 
German course. Like the French and Spanish groups of that year, 
they met in class seven hours per week (plus one concurrent 
hour of linguistics) for a total of 180 hours. The lecture 
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hours (two per week) were devoted to the presentation of fresh 
material and the analysis of grammatical structure; the five 
drill-hours were used for oral and aural practice with the 
material previously presented in lecture. Two hours of out-of- 
class study were required of the students. All staff members 
were native or bilingual speakers, and were experienced 
teachers of German. No mechanical audio-visual aids were 
employed. 

Group 1 was tested both visually and aurally twice during 
the year, with the following results: 



CO-OPERATIVE AURAL 



MARCH 1t48 


JUNE 1946 




MARCH 1946 


JUNE 


1M« 




2 QU. 


t YR. 




2 QU. 


1 


YR. 




ADV. 0 


ADV. Q 




LOWER A 


LOWER A 




MEAN 


MEAN (%DLE) 




MEAN (TENTH! 


1 MEAN 


(TENTH) 


R 


49.5 


54.2 (42) 


I 


6,8 (6) 


9.9 


(8) 


V 


51. 1 


55.5 (46) 


1 


5.6 (4) 


7.5 


(6) 


G 


49.6 


54.1 (55) 


M 


8.8 (5) 


11.4 


(6) 


T 


50.3 


55.0 (48) 


T 


21.2 (6) 


28.8 


(7) 


In 


the reading skills these 


students were 


below the one- 



year median in all except Grammar. In aural ability they were 
slightly above average by the end of two quarters; their third- 
quarter rise can be accepted only with reservations as far as 
progress is concerned, since the same forim of the ^.est was 
repeated. 

Group 2. Nine freshmen entering the B.A. progpram with 
previous high-school study of German took the intermediate 
experimental course.. This was scheduled at seven hours a week 
(three of analysis and four of drill), and four hours of 
outside study y/ere expected of the students. This group was 
tested four times: at the beginning of the first quarter and 
at the end of each quarter. We report scores for all testings 
except the third. 

^^Scores for all teatinga are given in Appendix B. 
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OCT. «»48 
t YR. 

ADV. 0 

MEAN (%ILE) 

51.3 (31) 
50.2 ( 26) 

52.0 ( 47) 

51.1 433) 



OCT. t94S 
1 YR. 

LOWER A 

MEAN (TENTH) 

I 7.4 (6) 

I 7.7 (6) 

m 7.6 (5) 

T 22.7 (6) 



CO-OPERATIVE 

DEC. t94S 
t YR. k t QU. 
ADV. Q 

MEAN 

59.6 

58.7 
59.1 
59.9 
AURAI. 

DEC. I»4S 
t YR. k t QU. 
UPPER A 

MEAN (TENTH) 

5.6 (5) 

20.6 ( 8 ) 

7.0 (6) 

33.2 (8) 



JUNE t»4« 

2 YRS. 

ADV . Q 

MEAN (WILE) 

65.7 (44) 

65.8 (43) 

62.4 (50) 
66.0 (45) 



JUNE t«4« 

2 YRS. 

UPPER A 

MEAN (TENTH) 

13.7 (9) 

29.6 (9) 

11.4 (9) 

54.7 (9) 



Like the elementary students, this intermediate group stood 
below the median on all scores for the Co-operative except 
Grammar. In aural ability they were on a par, at entrance 
from high school, with col lege -trained Group 1 at the end of 
two quarters. After one quarter they had made noteworthy aural 
progress: 8th tenth on the upper-level test. By the end of two 
years they placed in the 9th tenth- but this was on the third 
testing with the same form of the same test; they had taken it 
a second time at the end of the second quarter (March) and had 
then already reached the 9th tenth for total score. 

Comparison with Conventional Groups (German) 

Conventional German groups were tested in 1945-1946 at 
identical stages with the experimental groups,. The total 
number of hours accumulated by these German classes was the 
same as in the other languages (see p. 192). However, for the 
reasons stated above in coimection with those languages (see 
p. 193), we compare the experimental and conventional groups 
only on the basis of equal calendar time. 
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The scores of the conventional German groups are given in 
Appendix B. The following table shows the differences in the 
mean scores between the experimental group and its conventional 
counterpart on the same test at the same calendar stage. 



TABLE XIII 

Differences in Means between Eixperinental 
and Conventional Groups — German 



CO-OPERATIVE 

Group i t YR- 

R -3.1 

V -4.7 

G +4.4 

T -1. 1 

Group 2 1 yr.* 2 yrs. 

R -1.0 -1.3 

V -1.0 +1.4 

G +0.8 +1.8 

T -0* C +0. 5 



AURAL 

1 YR. 

I +3. 1 
1 +1.9 

n +2. 6 

T +7.6 





1 YR.* 


I YR. • 1 QU. 


2 YRS. 


I 


+1.0 


+1.1 


+3,1 


I 


+2.0 


+7.2 


+13.6 


HI 


-0.4 


+1.7 


+4.3 


T 


+2.6 


+10.0 


+21.0 1 



*At ^trane* frooi high tehool 

^For tha expairiaantal group, thia ia tha March rathar than tha 
Juno tooting. 



In reading skills, the experimental groups did not differ 
significantly from their conventional counterparts at one 
year or at two years. 

In aural comprehension, the intermediate experimental group 
significantly surpassed the corresponding conventional group 
at two years, and other (non -significant) differences are at 
least consistently in favor of ^ the ' experimental group. 

These figures constitute evidence that in 1945 *>1946 the 
German experimental program was successful in terms of its 
objectives. 



^®For full uxipianation of tllio figures, 
Fronch table/ p. 193* 



see that for the corresponding 
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Summary 

College J provides our most valuable body of data for 
comparison of results achieved in an experimental oral-aural 
program with the attainments of conventionally taught students. 
Both types formed part of an essentially homogeneous student 
body; although the type of language instruction they received 
was determined according to the curriculum (A.B. or B.S. ) 
they were following, the average of their intelligence, 
previous language background and general scholastic record 
differed little or none. Furthermore, while the A..B. groups 
took semi -intensive language courses providing oral-aural 
training through the utilization of increased in-class practice 
time, both types devoted approximately equal amounts of over- 
all time (including home study) to language and were thus 
measurable side by side, for progress and ultimate achievement, 
throughout the two- or three-year span of their study. 

The announced objective of the experimental program was to 
give the students a degree of oral and aural skill surpassing 
that imparted in conventional courses, and while devoting less 
time to direct instruction in reading, to produce equally high 
proficiency in that skill by the end of two years as an 
assumed consequence of early oral-aural command. The results 
of our testing give little evidence that this dual objective 
was impressively or consistently attained. In aural com- 
prehension, only 3 out of 9 experimental groups performed 
significantly better than their conventional counterparts at 
the end of two years. In reading (including vocabulary and 
grammar), two experimental groups were significantly poorer 
than the conventional groups at two years. Where differences 
Were non-significant, they tended to favor experimental group 
in aural comprehension and conventional groups in reading.. The 
aural differentials were the least that could be expected as a 
consequence of direct training. Oh the other hand the reading 
outcomes did not bear out in convincing fashion the theory 
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that an initial oral-aural command (of the still very imperfect 
kind possessed by these groups) can be substituted for direct 
training in that skill. 



College B 

College B, at which we extensively tested conventional 
classes and reported the results in Chapter V (p. 134 ff.)y 
also instituted a series of experimental intensive courses, 
beginning with the academic year 1944-1945, in French, German, 
Portugese, Russian, and Spanish. The Department of Romance 
Languages administered the experimental courses in all the 
languages mentioned except German, and in collaboration with 
that department we tested various intensive French, Spanish 
and Russian groups in 1945-1946 and 1946-1947. 

The intensive program was established at College B in 
response to what was felt to be renewed insistence, resulting 
from the war experience, on maximum possible attainment in the 
use of a foreign language studied. The program for each 
language was set up as a four -year seqpuence in Which qualified 
students who so desire may obtain a departmental major. The 
sequence constitutes in a very real sense a "language -and - 
area" program, since the materials employed for learning and 
practicing the use of the language, whether it be in reading, 
writing, or speaking, consist wholly of information about the 
area in which that language is spoken. 

Enrollment in the intensive program at College B is 
restricted to highly qualified students genuinely interested 
in acquiring second- language proficiency as implementation of 
their cultural studies or future careers.. Only those are 
admitted who have either a superior previous record in foreign- 
language study or a very high general average, or who demon- 
strate by tests a high linguistic aptitude. As a consequence, 
intensive enrollment up to the present time has been extremely 
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small. These circumstances make the program atypical as 
contrasted with the full-scale conversion to intensive 
instruction at College H, the fairly extensive experiment at ^ 
College J, or the practice at some colleges ol offering 
intensive courses on a purely optional basis. The results 
achieved in this atypical College B program might have 
important implications for the more generally prevalent type, j 

were it not necessary to interpret with extreme caution the j 

data yielded by the very small number of students involved. | 

Each of the first- and second-year intensive courses is under ^ 
the direction of a particular staff member who gives the 
grammatical instruction and co-ordinates the conversational | 

practice, given by a native -speaking instructor, with other j 

phases of the course. The amount of instruction given by the j 

director varies somewhat from course to course, but tends to | 

be about three hours per wc©k. Several of the directors are 
bilingual, and they begin conducting grammatical discussion 
in French or Spanish well before the end of the first semester 
of the elementary course. 

Practice groups for drill and conversation normally 
contain no more than ten students. In the opinion of the 
Department fully satisfactory native speakers to conduct these 
sessions can be recruited only from among experienced teachers 
— not necessarily language teachers, but perspns who under- 
stand ths implications oT the teacher- learner relationship and | 
the importance of lesson material carefully prepared in I 
advance of class. 

The French and Spanish courses were identically organized 
and may be treated together; Russian courses will, subsequently 
be treated separately. 

French and J^anish 

Groups la and lb. These groups represent the beginning | 
intensive course, open only to students with no previous | 

*: 

5 



I 

I 

! 

;i 

i 
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'j 

i experience in the language. It operated on a schedule of nine 

contact hours per week, thus accumulating 135 hours each 
semester for a total of 270 hours in the first year. The 
;{ students, expected to do appropriate amounts of out -of -class 

I study, received six hours* credit per semester, i.e., double 

the credit for a conventional three -hour course. Their 
I achievement at the end of the year is therefore measurable on 

a normal two-year basis. 

I Actually these groups were tested at points nearer the 

beginning than the end of their second semester. Ihis being 
the case, their Co-operative scores are measured against the 
one-year norms; but their aural scores, made as they were 
j during an "intermediate" semester, are subject to comparison 
I with the advanced norm-group for the lower -level test. 

Group la is composed of the students of 1945°1946; lb, those 
I of 1946-1947. Both were extremely small. Their scores: 





OO-OPERATIVE 




AURAL 






French la (f^5) 








FEI. 


lf46 < ISO HRS. > 




FEB. 


1946 (ISO 1- 






ADV. R 






LOWER B 




MEAN 


(1 YR. %ILE) 




MEAN 

% 


( TENTH) 


R 


52.2 


(40) 


I 


10.6 


(9) 


V 


58.8 


(47) 


n 


17.8 


(8) 


G 


57.4 


(63) 


TIT 


13.6 


(7) 


T 


56.8 


(50) 


T 


42.0 


(9) 






Spanish la (N^ 8) 










ADV. 0 








R 


65. 1 


(88) 


I 


13.3 


(9) 


V 


65.3 


(84) 


n 


15.0 


(8) 


G 


65.0 


(91) 


M 


20.5 


(8) 


T 


66.6 


(90) 


T 


48.8 


(9) 






French lb (t^7) 








MARCH 


1t47 ( ISO HRS. ) 




MARCH 1947 ( 18 






ADV . R 






LOWER A 




MEAN 


( t YR . %l LE) 




MEAN 


{ tenth 


R 


50. 1 


(32) 


I 


7.9 


(7) 


V 


62. 1 


(60) 


n 


11. 1 


(3) 


G 


59.4 


(70) 


HIT 


13.9 


(6) 


T 


57.6 


(53) 


T 


32.9 


(6) 



V 




I 
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Spaniih lb (f^l2) 



ADV. Q 



R 


64.4 


(87) 


I 


13. 1 


(9) 


V 


63.5 


(79) 


I 


16.3 


(9) 


G 

1! 


69. 1 


(96) 


m 


15.0 


(6) 


1' T 


67.3 


(91) 


T 


44.4 


(9) 



On the Co-operative tests, all were strongest in Grannmar, | 

a situation often characteristic of students taking an | 

■; i 

intensive course of the current type. Ir French, both groups 
in Beading, and Group la in Vocabulary, had not yet passed the j 

one -year median despite their 15 to 45 hours of post -elementary | 

instruction. 

! 

Oki the aural side both Spanish groups and French la showed 
superior performance, while French lb, with 25 more hours^: | 

failed to reach conparable levels. Ihe discrepancy can be due | 

merely to individual student,,, differences in these very small; j 

groups. i; I 

Groiq)s 2a and 2b. Ihese were students who, having completed^ 
two, three, or four years* high-school study of the language, 
took an intermediate intensive course meeting six hours per' 
week, 180 hours for the year. As in the beginning course, 
double credit was given. Their achievement at the end of the 
year is thus measurable on a three -year basis. 

Group 2a, that of 1945!>1946, was tested twice: the first 
time shortly after the begiiming of the course, and the second 
time at 140 hours on the 180-hour scale. This group comprised 
only three students in French and five in Spanish. Their scores j 

■t 

00-CH»ERATIVE AURAL . » 



French 2a (Ns3) 





OCT. 


1*45 


APR. 


1946 




OCT. 


1945 


APR. 


1946 




(30 HRS.) 


( 140 


HRS. ) 


1 ■■ 


(SO HRS.) 


( 140 


HRS.) ' 




ADV. 


R 


ADV. 


. R 




UPPER A 


UPPER a 






( t YR. 




(3 YR. 


' 












MEAN 


%0'lE) 


MEAN 


%0LE) 




MEAN 


(TENTH) 


MEAN 


(TENTH 


R 


63.0 


(79) 


71.0 


(35) 


I 


8.0 


(5) 


5.7 


' (2) i 


V 


69.7 


^85) 


73.0 


(18) 


I ; 


15.0 


(4) 


12.0 


" (4) 


G 


68.3 


(93) 


74.7 


(85) 


n ,; 


5.0 


(8) 


5.7 


(4) 


T 


68.7 


(89) 


75.0 


(44) 


T ■ 


28.0 


(5) 


23 3 


(3) 
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Spanish 2a (f^5) 



ADV. Q ADV. Q 



R 


73.6 (98) 79.8 (75) 


I 


15.8 


(9) 


21.4 


(10) 


V 


73.4 (97) 89.0 (91) 


I 


35.6 


(10) 


38.6 


(10) 


G 


76.8 (99) 79.4 (90) 


M 


10.2 


(10) 


9.2 


(9) 


T 


77.0 (99) 85.6 (89) 


T 


61.6 


(10) 


69.2 


(10) 




Obviously, however, little 


weight can 


be a 


ttached 


to the 



perfonmance of three or five students at any given time. 

Group 2b, the 1946=1947 version of this same course, 



nunfcered eleven students in French and twelve in Spanish. They 
were tested once, at 120 hours on the 180=hour scale, with the 
following results: 

OO-OPERATIVE AURAL 



French 2b (^11) 





MARCH 


19 47 ( 1 20 HRS. ) 




MARCH 


1947 ( 1 20 HRS. ) 






ADV. R 






UPPER A 






( 2 YR. 










MEAN 


%ILE) 




MEAN 


(TENTH) 


R 


80.7 


(90) 


I 


16.3 


(9) 


V 


79.2 


(76) 


I 


28.8 


(9) 


G 


71.1 


(86) 


m 


4.4 


(7) 


T 


77.2 


(81) 


T 


49.5 


(9) 






Spanish 2b 


(mi2) 










ADV. Q 








R 


68.4 


(61) 


I 


11.9 


(8) 


V 


72.4 


(72) 


I 


26.2 


(7) 


G 


75.4 


(91) 


M 


5.3 


(6) 


T 


74.4 


(80) 


T 


43.4 


(7) 


This 


French group (which is 


of a 


more 


significant s: 



appears to have been considerably superior to French 2a, and 
even if measured by the three -year norms (which they need not 
be at only 120 hours), their scores would still surpass the 
others on both tests. In Spanish, on the other hand, the 
situation is reversed, with tiny Group 2a showing notably 
better results than the larger 2b in both fields. 

Groups 3a and 3b. These were the students who, having 
completed the 270-hour beginning course, took in the second 
year of the intensive sequence a course which was distinct 
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from that taken by the groups entering the program with high- 
school experience (2a, 2b). This course met only four hours 
per week (giving four seines ter-honrs’ credit), thus adding 120 
hours and bringing the two-year total to 390 hours. Their 
achievement at the end of this time is measurable on a three - 
year basis. The course was given only in Spanish in 1945-1946 
(Group 3a) and 1946-1947 (Group 3b). 

Group 3a was tested twice: once shortly after the beginning 
of the course, and again at 350 hours on the 390- hour scale. 
There were nine students.’® Their scores: 

CO-OPERATIVE AURAL 



Spanish 3a (N=9) 





OCT. 


1945 


APR. 


1946 




OCT. 


1945 


AP R . 


1946 




( 280 


HRS . ) 


( 350 


HRS. ) 




( 280 


HRS. ) 


( 350 


HRS. ) 




ADV. 


Q 


ADV. 


. Q 




UPPER A 


UPPER A 






(2 YR. 




(3 YR. 














MEAN 


%ILE) 


MEAN 


KILE) 




MEAN 


( TENTH ) 


MEAN 


( TENTH) 


R 


75.4 


(84) 


79.4 


(73) 


I 


16.1 


(8) 


18.4 


(9) 


V 


85.9 


(97) 


92.3 


(95) 


1 


26.1 


(6) 


35.1 


(9) 


G 


76.9 


(93) 


79.8 


(91) 


m 


5.2 


(6) 


8.6 


(9) 


T 


82.1 


(95) 


86.9 


(91) 


T 


47.4 


(7) 


62.1 


(10)’ 



These figures, especially in the field of the reading 
skills, speak for themselves. 

Group 3b comprised four of the eight members of the Spanish 
la group of the preceding year.. They were tested once, also 

after 350 of their 390 hours. The results: 

! 

CO-OPERATIVE , AURAL 

Spanish 3b 

MAR. 1947 (350 HRS.) MAR. 1947 ( SSO HRS.) 

ADV. 0 UPPER A 

( 3 YR. 





MEAN 


KILE) 




MEAN 


(TENTH) 


R 


74.0 


(52) 


I 


11.8 


(5) 


V 


93.0 


'(96) 


1 


27.5 


(7) 


G 


79.0 


(90) 


HI 


4.8 


(6) 


T 


85.0 


(87) 


T 


44.1 


(7) 



Two of the four fftiled to tftke the Co-operetiYe Teat. 



^%heir Ohio Pcychologicel decile mean waa 6.9 (cf. p. 141). 
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In comparing these students* scores on the aural test with 
those of Group 3a, it should be noted that they took it only 
once, while the others' 350-hour scores are the result of a 
second exposure to the same form. 

Group 4. These students were taking the third course of the 
intensive sequence, which is designed as a literary course 
meeting three hours per week. It is distinct from the conven- 
tional literature courses in that a large amount of material 
can be thoroughly covered — - entirely in the foreign language 
— - not only because of the students' greater proficiency in 
handling the language itself, but also because of the greater 
amount of introductory background in literature and civilization 
gained in the preceding courses of the intensive sequence. 
Simultaneously with the courses in literature, the students 
take a two-hour -per-week course in conversation for one hour 
of credit. 

We tested Group 4 only in 1945-1946, during which year all 
its members, in both French and Spanish, had formerly completed 
the course for students with high-school experience, in which 
they had accumulated 180 hours within the program. The advanced 
course (counting the conversation phase) added 150 hours, 
bringing the total to 330. The group was tested twice: once 
shortly after the beginning of the course, and again at 280 
hours on the 330-hour scale. There were three students in 
French, and four in Spanish of whom two are excluded from the 
data as being native speakers of Spanish from Puerto Rico. The 
scores for Group 4,^^ which at the second testing are measured 
by the four-year norircs, are as follcws: 



27|QeciJLe meina on the Ohio Paychological Teat; French 8.0, Spanish 6.S, 
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CO-OPERATIVE 










AURAL 












French k (f^3) 










OCT. 


tS>45 


APR. 


1948 




OCT. 


1945 


APR. 


1946 




(19S 


HRS. ) 


( 380 


HRS. ) 




( 199 


HRS. ) 


( 280 


HRS. ) 




ADV. 


R 


ADV. 


R 




UPPER A* 


UPPER B 






(3 YR. 




(4 YR. 














MEAN 


%ile; 


MEAN 


%I1.E) 




MEAN 


(tenth! 


. MEAN 


(TENTH! 


R 


91.3 


(94) 


98.3 


(99) 


1 


21.0 


(9) 


10.3 


(6) 


V 


82.0 


(52) 


86.7 


(53) 


I 


35.7 


(9) 


20.3 


(7) 


G 


76.7 


(89) 


70.0 


(58) 


Til 


8.3 


(7) 


8.7 


(7) 


T 


87.0 


(86) 


88.7 


(80) 


T 


65.0 


(9) 


39.3 


(7) 








Spanish 


4 (N^2) 










ADV. 


Q 


ADV, 


. 0 








(A) 


R 


71.0 


(40) 


82.5 


(63) 


I 


U.5 


(7) 


21.0 


(10) 


V 


90.0 


(92) 


96.0 


(93) 


1 


26.0 


(6) 


35.0 


(9) 


G 


81.5 


(94) 


78.5 


(79) 


ITT 


6.0 


(7) 


8.5 


(9) 


T 


83.5 


(85) 


89.0 


(85) 


T 


46.5 


(7) 


64.5 


(10) 


Six 


montha 


earlier 


these students 


had taken a 


tryout 


form of 


il Upper A, 


with th 


e msterisl s 


ipoken 


by their instructor, 





Russian 

In Russian, with the exception of a one-year special course 
of three hours in scientific Russian, all instruction is given 
within the intensive program. 

Group 1. The beginning course in Russian is conducted, as 
in French and Spanish, on a basis of nine contact hours per 
week for a total of 270 hours in the first year. Credit is for 
six semester-hours. 

Ihe beginning Russian group was not tested in 1945-1946. 
The twenty members of the 1946-1947 beginning course were 
tested at 180 hours, with the following results: 



CO-OPERATIVE AURAL 

Russian 1 (N=20) 





MARCH 


(947 ( 180 HRS. ! 




MARCH (947 


( 180 HRS.! 




1 NVESTTGATION* S TEST 




LOWER 


A 




MEAN 


( TENTH! 




MEAN 


( TENTH! 


R 


18.0 


(6) 


I 


9.3 


(6) 


V 


12.7 


(5) 


1 


13.1 


(5) 


G 


16.0 


(5) 


M 


14.0 


(4) 


T 


46.7 


(5) 


T 


36.4 


(5) 
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Groups 3a and 3b. These were students who, after having 
completed the 270-hour beginning course, took in the second 
year a course meeting .six hours per week (for six credits),^® 
thus adding 180 hours and bringing the two-year accumulation 
up to 450 hours. 

Group 3a (1945-1946) was tested twice with the aural test 
only; once shortly after the beginning of the course, and a 
second time at 400 hours on the 450-hour scale. 29 

AURAL 

Auttian 3a (N=6) 

OCTOBER 1*45 (290 HRS.) APRIL 1946 (400 HRS.) 







LOWER A 




UPPER A 




MEAN 


(TENTH) 


MEAN 


(TENTH) 


I 


13.2 


(7) 


10.7 


(5) 


1 


16.7 


(7) 


22.0 


(5) 


M 


24.5 


(8) 


10.5 


(7) 


T 


54.4 


(8) 


43.2 


(6) 



Group 3b (1946-1947) was tested once at 400 of the 450 
hours , as was Group 3a. 

CO-OPERATIVE AURAL 

Russian 3b (N=^) 





MARCH 1947 


(400 HRS. ) 




MARCH 


1947 (400 HRS.) 




INVESTIGAT 


ION’S TEST 






UPPER A 




MEAN 


(TENTH) 




MEAN 


(TENTH) 


R 


19.5 


(6) 


I 


8.e 


(4) 


V 


17.5 


(8) 


JI 


18.5 


(4) 


G 


15.5 


(5) 


M 


1.5 


(1) 


T 


52.5 


(6) 


T 


28.8 


(2) 


Summary 












By and large the 


results attained 


T the intensive program 



at College B, as measured by the Investigation’s tests, are 
seen to be superior in both the reading and the aural field. 



contrasted with only four hours (snd four credits) in French and 

Spanish. 



2^heir Ohio Psychological decile mean was 6.0. 
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The students had been carefully selected for qualifications 
and interest, and they constitute our best example of what can 
be accoijqplished on a limited basis which, rules out students of 
mediocre aptitude or slight motivation* Unfortunately for 
our studies, the numbers of qualified and interested students 
receiving intensive instruction at College B were so small 
that the results must be subject to cautious interpretation. 

College C 

As stated in Chapter V, we tested language groups at College 
C in both 1945-1946 and 1946-1947. We reported the results 
from the first of those years in Chapter V because the courses 
were all conventional. The data from the second year are 
treated here because at that time one new experimental section 
was instituted both in French and in Spanish. 

The experimental course was intended to bring students 
without previous experience in the language up to a two-year 
level of competence in one year of study. No mere telescoping 
of two conventional years into one, it was further designed to 
test the assumpticm that, by making speech the initial approach, 
it would be possible in the same amount of time to develop 
aural and oral skills more than is normally done in conventional 
courses and yet to attain the same degree of reading ability. 

Of the nine contact hours per week, six were devoted to 
classroom work with the full group meeting together — for 
explanation of grammatical structure and for some oral 
exercise — under the course director who was himself a native 
speaker. Three more hours a week were used for conversation 
sessions led by a native speaker who was not a trained teacher. 
For these conversation hours the full group of about fifteen 
students was divided into separate sections of five each. 
These three conversation hours supplanted home study and 
required no outside preparation. For the six class hours, 
which did require extra study, six credit hours were given and 
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in that light the course was regarded as essentially the 
double of a conventional course. Thus the 135 hours of the 
first semester are to be equated with the 90 hours of one 
regular year, and the full 270 hours with the 180 hours of two 
regular years. 

In theory, the intensive course was open to .students who 
were above average in aptitude and had had no previous experi- 
ence in the language. In actuality, ja few of the students* were 
average or, less in aptitude, hardly any were brilliant, and 
several were veterans who had studied the language slightly 
some months or years earlier. 



OO-OPERATIVE AURAL 

French (N~i3) 





JUNE 


lt47 


( 270 HRS. ) 




JUNE 


194? ( 270 HRS 






ADV. 


P 






UPlr'ER B 








U YR. 










MEAN 




«ILE) 




MEAN 


(TENTH) 


R 


75.7 




(80) 


I 


12.2 


(10) 


V 


73.5 




(57) 


1 


16.5 


(8) 


G 


66.5 




(69) 


m 


6.2 


(7) 


T 


7 4.2 




(70) 


T 


34.9 


(10) 








Spanish 


(N^iS) 










ADV. 


0 








R 


70.6 




(70) 


I 


14.1 


(9) 


V 


67.7 




(54) 


1 


17.1 


(10) 


G 


72.1 




(84) 


m 


8.2 


(7) 


T 


72.2 




(72) 


T 


39.4 


(10) 



The Spanish section had previously taken the Lower Level 
Form A aural test along with conventional groups in January, 
1947, at 135 hours. The mean of fourteen of the fifteen 
students on the total for that test was 41.8, which places 
them in the 9th tenth of the one -year norms. 

At the 270-hour (two-year) level, the French section is 
seen to have been strongest in Beading, the Spanish section in 
Grammar, with both weakest in Vocabulary. The over-all 
performance in the two languages is strikingly similar, and 



218 



AN investigation OF SECOND -LANGOAGE TEACHING 



while good in the reading skills is definitely superior in the 
aural field. 

Comparison with Conventional Groups 

Since conventional groups were also tested in Jwpe, 1947, 
we have valuable comparative data against which to measure the 
attainments of the experimental group. Ihe scores made by the 
regular groups appear in Appendix B. Ihe following table sets 
forth the differences between the means of the intensive group 
and those of the regular second -year group which was at the 
same time completing 180 hours of conventional instruction. A 
plus sign means that the difference favors the experimental 
group; a minus sign that it favors the conventional. 

TABLE XIV 

Differences between Means of Experimental 
and Conventional Groups — College C 





CO-OPERATIVE 




AURAL 


French 


R 


+ 6.1 


I 


+ 6.2 




V 


- 0.5 


|[ 


+ 3.7 




G 


+ 0.8 


TIT 


+ 1.4 




T 


+ 2.1 


T 


+ 11. 3 I 


Spanish 


R 


+ 2.7 


I 


+ 3.4 




V 


+ 1.1 


M 


+ 8.1 




G 


+ 6.2 


in 


+ l:^ 




T 


+ 3.7 


T 


+13. 0^ 



Oi the January aural testing at 135 hours, the Spanish 
experimental group surpassed its conventional (90-hour) 
counterpart by 14.0 on the total score, a difference which is 
significant at the 1% level. 

It is thus objectively demonstrated that the goals of the 
experimental course were successfully attained. Moreover the 
similarity of the differences for both languages suggests that 
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they are not the result of chance, hut rather of the effective- 
ness of teaching procedures which are shown to justify the 
theory on which they were based. 



College K 

Parallel to the conventional elementary courses, experimental 
intensive courses were instituted at College K (a large state 
university) by the departments of Homance Languages and German 
in the year 1944-1945. In co-operation with these departments, 
the Investigation followed experimental and conventional 
groups in French, Spanish, and German during 1945-1946, the 
second year of the intensive program’s operation. Inasmuch as 
the intensive courses did not follow an identical pattern for 
all languages, we present the data for each separately. 

One principle common to all the languages, however, was 
that the intensive courses were not designed to telescope the 
coverage of two years into one, but rather to convert the 
student’s normal out-of-class study into supervised drill in 
the presence of a native speaker. The objective of the 
experimental course was therefore the acquisition of the usual 
reading ability plus a better developed control of the spoken 
language than is normally imparted in conventional instruction. 
Regular courses met five hours per week, and five credits were 
assigned for either regular or intensive courses. Students 
were free to elect either type of course. 

French 

The elementary group. The experimental elementary course in 
French, as organized in 1945-1946, provided fifteen contact 
hours per week: five class hours of regular instruction in 
grammar and reading (duplicating in this respect the conventional 
course), plus ten hours of conversation practice. Eighteen out 
of the sixty-eight students enrolled in beginning French 
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elected the intensive section. They were tested at the end of 
the first quarter when they had accumulated 180 hours, and at 
the end of the second quarter at 360 hours. Their scores on 
the two testings were as follows: 

CO-OPERATIVE AURAL 



DEC. 1349 


MARCH 


French (N=18) 

1940 


DEC. 


1949 


MARCH 


1940 


( 100 HRS.) 


(300 


HRS. ) 




( 100 


HRS.) 


(300 HRS.) 


ADV. R 


ADV. 


R 




LOWER 


A 


UPPER 


A 


MEAN 


MEAN 


( 1 YR. 
%ILE) 




MEAN 


( TENTH) 


MEAN 


(TENTH) 


R 41.1 


65.1 


(84) 


I 


2.4 


(3) 


4.8 


(3) 


V 55.2 


67.6 


(80) 


M 


8.4 


(3) 


15 9 


(5) 


G 53.4 


60.2 


(73) 


m 


8.9 


(4) 


2.6 


(6) 


T 49.9 


65.6 


(82) 


T 


19.8 


(4) 


23.3 


(3) 



I- 

[ 




In March, having devoted 120 of their 360 hours to class 
instruction in reading, the group comfortably reached the top 
quarter of the one-year Co-operative norms. In the aural 
field, however, their performance was surprisingly low in view 
of the hours devoted to oral-aural practice. Their performance 
on the upper-level aural test is an interesting exemplification 
of the inability of first-year students to cope with difficult 
material despite many hours spent in listening to a native 
speaker. Their relatively high score on Part III (Dialogue), 
however, suggests that their general comprehension may have 
been ahead of their vocabulary. 

The conventional counterpart of this group was tested at the 
end of the year, at 180 hours. Their total means reached the 
93rd percentile of the Co-operative and the fifth decile of 
the lower-level aural norms. Actually we should have tested 
the experimental group at the end of the year also, instead of 
in March. Because of this inequality in time, there is no real 
comparability; but it seems not unlikely that in one more 
quarter the experimental group could have made up the difference 
on the Co-operative test and would have surpassed the others 
m the lower-level aural by a fairly wide margin. 



O 

ERIC 
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Spanish 

Group i. As contrasted with French, elementary Spanish 
provided only ten contact hours per week: the five of regular 
instruction, plus five of cmversational drill. lwenty=six out 
of the total first -year enrollment of ninety-four chose the 
intensive group, which was tested at the same calendar points 
as the French, namely at the end of the first quarter at 120 
hours, and at the end of the second quarter at 240 hours. Iheir 
scores on the two testings: 

CO-OPERATIVE AURAL 

Spanish 1 (N=2S) 





DEC. tS4S 


MARCH 


1944 




DEC. 


I94S 


MARCH 


1 94S 




( 120 HRS. ) 


(240 


HRS. ) 




(120 


HRS. ) 


(240 


HRS. ) 




ADV. Q 


ADV. 


Q 




LOWER A 


UPPER 


A 








(1 yr. 














MEAN 


MEAN 


%ILE) 




MEAN 


(TENTH) 


MEAN 


(TENTH) 


R 


4S.5 


52. 3 


(43) 


I 


3.7 


(4) 


6.6 


(4) 


V 


40.5 


46.7 


(19) 


n 


8.0 


(3) 


18.4 


(4) 


G 


42.4 


55.3 


(61) 


M 


14.5 


(6) 


4.1 


(5) 


T 


42.2 


51.7 


(40) 


T 


26.2 


(4) 


29.2 


(4) 



Oh the Co-operative tests, comp>arison with the corresponding 
French group does not favor the Spanish, as the number of hours 
devoted to reading instruction was the same for both groups 
(120 hours by March) and the Spanish passed the median only in 
Grammar. Oh the aural side, however, the Spanish group reached 
almost exactly the same levels as the French (at least in 
terms of our deciles), both in December and in March, with 
only one -half the time devoted to oral-aural drill. 

Ibe conventional Spanish elementary group was tested at the 
end of the year, at 180 hours. Their total means stood at the 
90th percentile of the Co-operative and the fifth decile of 
the lower level aural norms. It seems doubtful whether in one 
more quarter the intensive group would have made up the 
difference on the Co-operative test, but they would have 
probably surpassed the others easily on the lower-level aural 
test. 
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Group 2. These eleven students had completed one year of 
intensive elementary instruction in 1944-1945. When tested in 
December, 1945, they were finishing the first quarter of an 
intensive intermediate course operating on the same schedule 
of ten hours per week distributed evenly between regular class 
instruction and conversational. drill. They had accumulated at 
this point a running total of 480 hours, llieir scores: 

CO-OPERATIVE AURAL 
Spanish 2 (N=ll) 





DEC . 


1945 (490 HRS.) 




DEC . 


1945 (480 HR 






ADV. Q 






UPPER A 






(2 YR. 










MEAN 


%I1LE) 




MEAN 


(TENTH) 


R 


67.6 


(58) 


I 


13.5 


(9) 


V 


66.4 


(48) 


n 


26.8 


(7) 


G 


68.7 


(76) 


n 


3.5 


(5) 


T 


67.5 


(56) 


T 


43.8 


(8) 



This group, with 240 hours of instruction in reading during 
one year and one quarter, had already passed the two-year 
median in all scores except Vocabulary. Their aural performance 
is good, though not exceptional considering the number of 
practice hours accumulated. 



German 

The elementary group. Intensive instruction in German was 
given only at the first-year level. After completing the 
elementary course, students continuing in German entered 
the regular intermediate course unsegregated from those who 
had begTin with the conventional instruction. As in Spanish, 
the intensive elementary course in 1945-1946 provided for ten 
contact hours per week: five of regular class instruction, 
each followed by an hour of conversational drill under a 
different (native) instructor.^® Fourteen out of sixty -three 



30Both regular and intenaive classes read Fr'dschel’s Himmel, meine Schuhe! 
(Heath); in addition, while the regular claaaea used Burkhard'a Lernen Sie 
Deutsch! (Holt), the intenaives worked with Rahder and Twaddell's Conversa- 
tional German (Holt), a text especially adapted to oral-aural procedures. 
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students enrolled in beginning' German elected the intensive 
course., Both the regular and the experimental groups were 
tested simultaneously at the end of the second quarter, and 
the latter was tested again at the end of the year. Vile list 
the scores of both groups, because in this case we shall be 
able to make close comparisons. 



CO- operative AURAL 

German Experimental Group (N-14) 





MARCH 


1t4« 


JUNE 


194S 




MARCH 


1946 


JUNE 


1949 




(240 


HRS. } 


(3t0 


HRS. ) 




(240 HRS.) 


(3«0 


HRS. ) 




ADV. 


0 


ADV. 


0 




LOWER 


A 


UPPER A 






(1 YR. 




(1 yr . 














MEAN 


KOLEH 


MEAN 


%DLE} 




MEAN 


(TENTH) 


MEAN 


(TENTH) 


R 


51.1 


(31) 


56.1 


(49) 


1 


7.4 


(6) 


6.6 


(7) 


V 


47.5 


(18) 


57.0 


(53) 


H 


6. 6 


(5) 


18.1 


(7) 


G 


52.6 


(51) 


56.9 


(67) 


M 


8.6 


(5) 


7.9 


(7) 


T 


50.3 


(29) 


57.1 


(57) 


T 


22.6 


(6) 


32.6 


(8) 






German Conventional Group (N=49) 








MA RCH 


fS4S (120 HRS. 


J 




MARCH 


194t (120 HRS 


. ) 


R 


52.9 


(38) 






I 


4.8 


(5) 






V 


50.5 


(28) 






H 


4.4 


(3) 






G 


55.0 


(59) 






Hff 


7.8 


(5) 






T 


53.0 


(40) 






T 


17.0 


(4) 


1 





In March although the conventional group was ahead of the 
experimental by small margins, the difference in total-scores 
proved non-significant. At the same stage the experimental 
group bested ,the conventional on Phrts 1 and II of the < aural 
test; but on Part III (Anecdotes) they were unable tp, excel, 
presumably because of their sparse vocabulary (cf . their low 
Co-operative Vocabulary score). The difference between the 
aural totals was also non -significant. 

Substantially all the students in both German groups had 
taken, on entrance to College K, the ACE College Aptitude Test 
of 1937. The raw-score means of the two groups on this test 
were 

l&cperimental Group: 94.2 
Conventional Group: 88.9 
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This difference too was non-significant. 

Summary 

At College K all the experimental groups except the Spanish 
elementary produced results indicative of success in achieving 
the reading objective. Moreover, in view of the satisfactory 
performance of the intermediate Spanish group also tested, it 
seems reasonable to infer that those students had reached an 
acceptable level of reading skill at the end of their first 
year, and that the failure of the 1945=1946 elementary group 
to do so may have been due to the quality of the students or 
to other factors rather than to the methods of instruction. 

College L 

A joint committee representing the Departments of Romance 
Languages, German, and Slavonic Languages at College L (a 
large state university) recommended revision, of basic-level 
language courses in such a way as to embody certain essential 
features of current experimental instruction: (1) concentration 
of time devoted to language study, (2) reduction in the 
number of students per class section, (3 ) increased emphasis 
on use of the spoken language on the assumption that oral -aural 
proficiency is not only a valid aim in itself but that it can 
also facilitate the acquisition of an appreciative and durable 
reading knowledge . We are ccaicerned here with changes made, as 
a result of the coimmittee’s recommendations, in the basic 
French and Spanish courses, some sections of which we tested 
in 1946 and 1947. 

The Year i945-i946 

The 'first year of experimentation (1945-1946) saw estab- 
lished the experimental framework within which a more 
controlled series of operations were carried out in the 
following year. The traditional arrangement, which was 
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continued for students already embarked on the fulfilment of 
their three-year language requirement, consisted of an 
elementary-intermediate sequence followed by a third-year 
course, all on a three -hour -per -week, three-credit basis. In 
1945-1946 the initial two-year sequence was paralleled by a 
new five -hour, four-credit course of one year, designed to 
prepare students for the third -year course in five -sixths as 
much contact time as the earlier program and in one -half as 
much calendar time. We tested French and Spanish groups of 
both the experimental and the traditional type, but on 
different bases in the respective languages. 

The French experimental group. The several sections of this 
first experimental French course spent an average of six 
introductory hours on pronunciation, using phonetic symbols 
and the exercises in Swansea’s Concise French Grammar; there- 
after they covered all the lessons of the above grammar and of 
IHendrix and Meiden*s Beginning French, read Maupassant: Six 
Contes Choisis and (outside of class) five of the first six 
booklets of the IH^ath-Chicago Rapid Reading Series. Chief 
innovations of the course were considered to have been greater 
insistence on pronunciation, which was repeatedly checked and 
twice recorded for each student, and the use of phonograph 
recordings of the pronunciation drills in ~the grammar and of 
all the readings in Beginning French. 

Both the experimental and the traditional group were given 
the Co-operative Test. Ihe results were not available to us, 
but it has been reported that comparison favored the experi- 
mental group. Our aural comprehension test was also administered 
to both groups at an equal number of contact hours (110), the 
following scores resulting: 
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French Experimental Group (N=^18^) Traditional Group (M=53) 





LOWER 


A 




LOWER A 




MEAN 


(TENTH) 


MEAN 


(TENTH) 


I 


4.5 


(5) 


4.2 


(5) 


1 


12.2 


(6) 


13.0 


(6) 


mr 


10.3 


(5) 


10.6 


(6) 


T 


27.0 


(6) 


27.8 


(6) 



Differences are minimal on all parts of the test. 

The Spcnish experimental group. In the first semester this 
group used LaGrone’s Conversational Spanish for Beginners, and 
read about forty-five pages of Roessler and Remy’s First 
Spanish Reader. In LaGrone the translation exercises were 
usually written by the students; the questions on the reading 
selections were used in various ways at the instructors' 
discretion; the readings themselves were normally translated, 
and also formed the basis of conversation in Spanish. Some 
instructors made recordings of students* speech as an aid in 
teaching pronunciation. In the second semester they covered 
alternating assignments in Grismer and Arjona's Short Spanish 
Review Grammar and Ashburn's Selected Spanish Short Stories. 
Ihe latter book, of which they read about seventy pages, proved 
too difficult, so that selected lists of words used were 
mimeographed to serve as a basis for active vocabulary building. 
Answers to the questions based on the stories were written out; 
there was considerable oral translation in class from Spanish 
to English, and frequent dictations were given. 

Ihe aural test was administered to one section of the 
experimental course and eight of the traditional course at the 
same calendar time in January, 1946. The experimental group 
had completed 110 hours, the traditional group about 130 hours. 
The scores: 
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Spanish Experimental Group (N-15) Traditional GroUp (N-133) 

LOWER A LOWER A 





MEAN 


(TENTH) 


MEAN 


(TENTH) 


I 


8.0 


(8) 


5.5 


(6) 


II 


12.4 


(6) 


10.1 


(5) 


M 


16.1 


(7) 


11.7 


(5) 


T 


36.5 


(8) 


27.3 


(5) 



Hie appreciable difference between the scores of the two 
groups is significant. 

The Year m6-i9k7 

During the first year of experimentation it became in- 
creasingly clear to the staff that, with or without objective 
data on the current operation, many questions of technique 
were still going unanswered. For example, what is the value of 
dictation? Is oral-aural drill the gateway to reading ability? 
Can a near-perfect accent be imparted to first-year students? 
Can pronunciation best be taught through imitation or through 
phonetic description? Can rote drill be used to teach grammar/ 
What degree of grammatical accuracy should be insisted upon? 
In the hope of arriving at scmie satisfactory answers to these 
and many other similar questions, it was agreed by the Romance 
Language Department to organize and carry out experimentation 
in techniques within the frame of the newly established five- 
hour basic course. The outcomes of such experimentation were 
to be evaluated by different types of objective test. The 
University administration agreed to bear extra expenses 
connected with the experiments. 

For the year 1946-1947, it was decided to use two approaches, 
systematically differentiated on the following basis: Plan A, 
an essentially traditional technique, using a text in normal 
orthography from the first day, teaching pronunciation mainly 
by imitation but without the supplementary use of recordings, 
teaching grammar inductively and with written exercises, and 
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not avoiding translation of reading material into English; Plan 
B, a more radical method, not allowing the students to see the 
written form of the language until several weeks after the 
beginning of the course, insisting on accurate pronunciation 
taught by phonetic description and supplemented by extensive 
use of recordings, teaching grammar deductively as points 
arise in connection with reading and requiring no composition 
by the students, and insisting on all feasible classroom use 
of the foreign language from the outset. 

Approximately twelve hundred students, comprising sixty 
sections of twenty each, took the basic course in 1946-1947. 
Half of the sections were taught in accordance with Plan A and 
the other half followed Plan B. Students were not al^lowed to 
shift from one plan to the other at mid-year. 

Two hundred eighty-nine French and five hundred fifty 
Spanish students following Plans A and B took the Co-operative 
and aural tests at 110 contact hours in March, 1947, with the 
following results: 





CO-OPERATIVE 








AURAL 








French Plan 


II 

-IS 






ELEM. 


n 






LOWER A 




MEAN { t 


YR. %1LE) 




MEAN 


(TENTH) 


R 


56.7 


(57) 




I 


4.3 


(5) 


V 


59.7 


(52) 




1 


10.5 


(4) 


G 


57.6 


(65) 




Ilf 


10.5 


(5) 


T 


58.7 


(59) 




T 


25.3 


(5) 








French Plan 


B (N=m) 




R 


52.7 


(43) 




I 


4.9 


(6) 


V 


56.7 


(39) 




H 


10.0 


(4) 


G 


52.4 


(40) 




M 


9.6 


(5) 


T 


54.3 


(39) 


: 


T 


24.5 


(5) 








Spanieh Plan A (N=287) 






ELEM. 0 


OR P 










R 


59.0 


(71) 
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5.9 


(6) 


V 


52.9 


(39) 




H 


10.7 


(6) 


G 


55.3 


(61) 




M 


14.9 


(6) 


T 


56.4 


(56) 




T 


31.5 


(7) 
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Spaniih Plan B (N=263) 



R 


60.2 


(74) 


I 


6.7 


(7) 


V 


53.? 


(43) 


I 


11.2 


(6) 


G 


53.7 


(57) 


TW 


15.3 


(6) 


T 


56.6 


(60) 


T , 


, 33.2 


(7) 



The most striking difference is that between French Plan A 
and Plan B on the Co-operative test, favoring Plan A by a 
fairly wide margin on each of the three parts. Oh the total 
score, the 4.4 difference in means proved to be significant at 
the 1%. level. At 110 hours out of the 150 provided in a course 
aiming to reach a two-year level at the end, French Plan B had 
not yet reached the one-year median in any part of the 
Co-operative test. 

In Spanish the differences on the Co-operative are all non- 
significant. 

Apart from the obvious fact that the Spanish groups give 
evidence of generally higher aural competence than the French, 
there is nothing to be observed regarding the comparative aural 
scores . 

These are, of course, meager objective data by which to 
answer the question of which Plan yields better results in 
what kinds of foreign- language competence. One indication, 
seemingly valid for French but not supported by the parallel 
data in Spanish, points to Plan A, the more traditional 
technique, as superior for the teaching of reading ability, 
passive vocabulary control, and grammatical analysis. At least 
there is no evidence in this body of data to the cmtrary. 

In any case the language staff at College L are convinced 
that they are on the right track and that if they are able to 
carry out their three years of experimentation, they will 
possess valid objective answers to some of the important 
problems of foreign -language teaching. Teachers everywhere may 
look forward with interest to the full reports which the staff 
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promise to make public on their procedures and findings at the 
end of each year. 

College M 

In 1945-1946 the Department of German initiated an experiment 
at College M (a privately endowed college for women) in the 
teaching of its introductory course. Two considerations 
influenced the decision to try the experiment: (1) the success 
of the methods used in Armed Service language courses seemed 
to warrant their adaptation to college teaching wherever 
possible; (2) the traditional attempt to develop speaking, 
understanding, reading and writing ability simultaneously, 
without distinguishing between the relative importance of 
these skills, was increasingly felt to be producing neither a 
high level of achievement in any one of them nor (generally 
speaking) an appreciation for the living language. 

As designed to fulfill the college language requirement and 
to serve as a prerequisite for advanced language and literature 
studies, the experimental course was conceived to have the 
following aims: 

1. A reading knowledge effectively usable in later Gierman 
courses and in other fields. 

2. A fair degree of facility in speaking and comprehending 
German. 

3. An understanding of the structure of the language. 

4. Some practice in expression in written German. 

A report from the course director goes on to state: 

Sinc«2 most students who study Germsn in college do so in order to 
acquire a reading knowledge, this aim had to be of major importance 
and the course had to be planned with this in mind. It seemed 
probable , however , that this objective could be accomplished more 
effectively if emphasis were put from the beginning on that most 
natural approach to any language, the spoken word. Besides, most 
students, particularly women, have always had a lively interest in 
learning to speak and understand a foreign language, even when their 
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ultimate aim has been the acquisition of a reading knowledge. In 
order to speak and comprehend and to read fairly complicated texts 
it is essential that the student learn to see how the language 
"works," that is, to understand what is generally included under 
"grammar," and, beyond that, to acquire some understanding of word 
formation, sentence structure and meaning, and, if it is not too 
presumptuous to hope to accomplish in an introductory course, to 
gain some feeling for style and some insight, no matter how slight, 
into the Geist of the language. 

We decided, therefore, to approach the learning of German through 
speaking and understanding the language. The development of these 
skills was to dominate' the work of the first semester. Reading was 
to be introduced as early as possible and was to take up an isicreasing 
amount of time in the second semester. Analysis of the structure of 
the language was to accompany and form a part of the work of both 
semesters. Writing was to occupy a relatively small amount of the 
student’s time throughout the year. 

In order to insure a registration large enough to make the 
experiment possible, Freshmen and Sophomores were excluded 
from the conventional three-hour elementary course, which 
continued open to Juniors and Seniors only. Forty-four students 
.. "^re enrolled in the experimental course. 

Organization was on a basis of nine contact hours per week: 
three of structural analysis and six of drill. For the analysis 
classes the group was divided into two sections of twenty- two 
each; and for drill there were several sections of not over 
nine students each, most of which were conducted by one drill 
instructor at the beginning of the week and by another at the 
end. 

Each student was expected to spend a minimum of nine hours 
a week in out-of -class study. During the first semester extra 
evening drill sessions were arranged for those students who 
desired to do their preparation under staff supervision. In 
the second semester a special section, replacing three hours 
of drill, was arranged for successful students who wished to 
cover more than the regularly assigned readings. 
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The staff of the course consisted of the director (an 
American) and four drill instructors, two of whom were native 
(Germans. The director taught the sections in grammatical 
analysis, conducted weekly staff meetings, prepared assignment 
schedules, corrected all the written work done by the students, 
and determined grades after consultation with the drill 
instructors. 

The basic text, used throughout the year, was Behder and 
Twaddell’s Conversational German. In the first semester the 
method of mimicry -memorization was used exclusively in learning 
the units of the text. Presentation of a given unit was made 
in analysis class, and that unit was drilled in the practice 
sessions of the same week, to the point where the phrases and 
sentences could be reproduced naturally and unhesitatingly and 
where, after a few weeks, variations on the memorized patterns 
could be successfully produced. The first three units were 
learned entirely through hearing and imitating the instructor, 
the students not being permitted to see any written German 
until the third week. No attempt was made, however, to use any 
system of phonetic transcription. For the first seven units 
the German text was read only after the unit had been committed 
to memory and the students, well prepared in advance for the 
sight of the printed text, had little trouble in mastering its 
spelling peculiarities. 

Reading of extremely simple texts was begun in the sixth 
week of the course, occupying two of the drill hours through 
the first semester and three in the second semester. The way 
in which the reading problem was attacked is explained in the 
director’s report in a paragraph which merits quotation in 
full: 

Until the student was able to read well independently, the drill 
instructor first read the text aloud in German. The students 
repeated after the instructor either chorally or individually or 
both. An explanation of the meaning of words which were not under- 
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stood by the student was given by the instructor, in German whenever 
possible. When the text had been read and re-read in this way and 
the meaning was clear to the students, simple questions were asked 
and answered on the text in German. Insofar as possible, conversation 
and reading were combined. As the difficulty of the reading material 
increased, it became evident that the active vocabulary and the 
patterns of speech acquired in the learning of the "mim-mem" units 
were inadequate for answering questions on the texts read. Pending 
further study of more effective methods of applying the conversat ional 
method to the discussion of the reading mater ial,^^ a temporary 
compromise was made. In the reading of texts of advanced difficul ty 
we decided to aim at developing as large a passive vocabulary as 
possible and to attempt to awaken some feeling for the literary 
qualities of the text. Some of the passive vocabulary passed 
natur>ally into the active vocabulary of the students, but in each 
case the amount vras a wholly individual matter, depending not only 
on the frequency of occurrence of the word or construction but also 
on the receptivity of the student. Study of word formation which is 
so important in German was begun early in the year and continued 
throughout. Meanings of words, differences of usage, etc. were also 
emphasized with constant reference to the phrases in which they had 
occurred. Throughout there was as little as possible translation 
from the German into English. 

Throughout the course, nearly five hundred pages of text 
were read, from the Meath -Chicago German Series through 
Kfistner’s Die Verschwundene Miniatur to Puckett’s Intermediate 
German Readings 

The writing of German was introduced gradually after three 
weeks in connection with the basic textbook. By the second 
semester the students were writing on an average of once a 
week — not translating English to German by grammatical rule, 
but attempting to render certain English passages of the 
textbook in the German patterns already drilled and varied in 

3 1 w , . 

Italics ours. 

^^The special section referred to above substituted Rflseler’s Deutsche 
Novellen des Neunzehnten Jahrkunderts for the last-mentioned text, and 
covered over a hundred pages more than the regular students. 
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class. In the latter part of the course these written assign- 
ments were short Aufsdtze on some phase of the stories read and 
discussed in class. Students were warned against attempting to 
write anything which was beyond their experience, were 
discouraged from using a dictionary, and were judged primarily 
on their ability to express themselves in clear, simple, and 
fairly natural German. 

The aural test was given to the group in March after 200 
hours, and both the Co-operative and the aural in May at the 
end of the 270-hour course. Thirty-nine of the original 
forty-four students took the full battery of tests. Their 
performance at the end of the year is measured, naturally. 



against norms for two 


years 


of study. 


Tlie scores: 






CO-OPERATIVE 






AURAL 








MAY (270 HRS. } 




MARCH (200 HRS.) 


may 


( 270 HRS. ) 




ADV. Q 




LOWER 


A 


UPPER A 




MEAN (2 YR. %1LE) 




MEAN 


(TENTH) 


MEAN 


(TENTH) 


R 


71.4 (66) 


I 


14.1 


(9) 


9.5 


(8) 


V 


69.2 (57) 


n 


13.4 


(8) 


24.2 


(9) 


G 


78.3 (94) 


M 


14.6 


(7) 


7.6 


(7) 


T 


75.3 (79) 


T 


42.2 


(9) 


41.2 


(9) 


The 


group placed in the 


top quarter of the 


two* 


■year norms 



on the strength of their score in Grammar. Despite the large 
amount of reading covered in the course and the attempt made 
by the staff to develop the students’ passive vocabulary, 
(see p. 233), they did not reach so high a level of competence 
in these sections of the test as in Grammar, which was studied 
thoroughly under the course director in connection with the 
basic material of the Conversational German used from the 
beginning to the end of the course. 

Ihe effectiveness of the aural-oral approach as handled in 
the course is directly reflected in the aural scores, which 
are superior on both levels of the test. 

None of the group had done any previous study of German in 
secondary school. All but two had studied either another 
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modern foreign language or Latin for two to four years, and 
all but three of the thirty-nine had taken a C.E.E.B. Language 
Achievement Test for entrance to the college. 3 3 Their mean 
scores on those tests were as follows: 



French = 25 cases, average study 3 yrs. : 592.2 
Spanish - 3 cases, average study 2-2/3 yrs: 587.3 
Latin - 8 cases, average study 3-1/4 yrs: 557.0 



All these scores are seen to be above the C.E.E.B. median of 
500. 

The coefficients of various correlations of the Investigation 
test scores with each other and with three items of supplemen- 
tary data are shown in the following table: 



TABLE XV 

College M: Correlations 



German 
Experimental 
Group CN-39) 









SECOND 


GRADE- 




CO-OPER- 


SAT 


SEMESTER 


POINT 




ATIVE Q 


VERBAL 


GRADE 


average 


SAT VERBAL 






.46 


.42 


CO-OPERATIVE 0 




.52 


.76 




AURAL UPPER A 


.63 


.49 


.62 





Purtisi Correlations: 



1 ) Co-operatire Q and Aural Upper A, with SAT-acore held constant: i50 

2) Co-operatire Q and Second Seiaeater Grade, with SAT-acore held constant: .69 

3) Aural Upper A and Second Semester Grade, with SAT- sc ore held constant : .51 

4) Aural Upper A and Second Semester Grade, with Co-op. Q held constant: .28 



'Ihe correlation between Co-operative and aural is high. Even 
with the intelligence factor, as measured by the SAT -score 
(the College Board’s Scholastic Aptitude Test) held constant, 
it is .50, which is the highest of these particular partial 
correlations to be found anywhere in our data. Ihis group was 
more than usually successful on both the Co-operative and 



330ne was an advanced-standing transfer student from another college. 



i 



i 



*1 
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(especially) the aural tests, and the high correlation figure 
(in which intelligence is not a strong factor) would suggest 
that the success in both fields was due to effective teaching 
of both types of skill side by side. The same assumption is 
borne out by the remaining correlation figures. While course - 
grades seem to have rewarded the visual skills (doubtless 
including writing) somewhat more than the aural (-oral), the 
Aural-with-Semester Grade correlation does not drop sharply 
from the Gj-operative -with -Grade correlation (cf. , for example, 
Colleges A and B, pp. 131, 142); and moreover when the Co- 
operative score is partialed out, the coefficient (.28) is not 
strikingly low. 

This pattern, as we interpret it, does not lend weight to 
the assumption made in some quarters that aural skills 
automatically show high correlation with visual skills, even 
if they are taught as secondary aims or not stressed at all. 
To us what is reflected here, rather, is the successful 
teaching of both types of skill as parallel objectives; and, 
in reflecting just that, they are in contrast with the lower 
correlation figures we have found in programs where either (a) 
aural development is a secondary aim of conventional iilstruction 
(cf. College B) or (6) both oral-aural and reading ability 
are leading aims of experimental instruction (cf. College H) 
in which, however, a more effective method of teaching reading 
has yet to be worked out. 

College N 

A small-scale experiment in elementary French was undertaken 
at College N (a large state university) in 1945=1946 and was 
repeated in 1946=1947 on a partially revised basis. The 
conventional elementary course was retained both years, and 
enrollment in the experimental course was limited, though not 
on a selective basis, being merely the result of chance 
arrangement of class sections. 
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Ihe experiment was not designed to bring students ei I'rench 
to a two-year level in one year, but rather to produce, in 
terms of one year objectives, a degree of oral-aural compe- 
tence higher than that normally achieved in the regular 
program, and an equal reading ability. The traditional first - 
year course provided five class hours per week, for which ten 
hours of outside study were expected. Ihe experimental course 
called for eight class hours weekly and only four of home 
study, thus demanding (theoretically) less of the students’ 
total time than the regular course. Ihe eight contact, hours 
were distributed evenly between four of class and four of 
drill in small sections, with no outside preparation required 
for the latter. Ihe drills v.’ere conducted by native speakers 
of French who were regular members of the departmental teaching 
staff. 

Group Jffli. The 1945-1946 experimental group, twenty- five in 
number, used as its basic text for oral-aural work Denoeu and 
Hall’s Spoken French, following prescribed procedure,** and 
for the transition to reading employed DeSauze’s Commenqons a 
lire. The conventional beginning group used Pargment's 
Initiation a la longue fran^aise. 

The experimental group was given the Investigation’s aural 
test in April, 1946» at 200 hours, and the Co-operative Test 
at the end of the year, at 240 hours. Ninety-three students in 
the regular course were also given both the Co-operative and 
the aural at the end of the year, at 150 hours. We list the 
scores of both groups: 



3^For an outline of this procedure aee College N (p. 164) and College J 
(p. 180). 
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CO-OPERATIVE AURAL 

French Exper imentnl Group ia (N-25) 

MAY 194C (240 HRS.) APRIL 1S4C (200 HRS.) 

ADV. R LOWER A 



MEAN ( t 
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(TENTH) 
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(62) 
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(7) 
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(68) 
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(5) 
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(65) 
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8.0 
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(67) 
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24.8 


(5) 




French Regular Group (N=93) 




may 1944 


( (80 HRS. ) 




MAY 18>4t 


(180 HRS. ) 


R 63.7 


(81) 


I 


3.2 


(4) 


V 63.5 


(68) 


1 


10.6 


(5) 


G 63.3 


(82) 


Tlf 


5.4 


(3) 


T 64.9 


(80) 


T 


19.1 


(3) 


While the performance 


of the experimental 


group is we 



above the median in all parts of the Co-operative test and might 
be regarded as representing an acceptable level of attainment, 
the scores of the regular group are significantly superior (at 
the 5% level) in Beading and Grammar as well as on the total. 

On the other hand, on the aural test, the total mean 
difference of 5.7 favoring the experimental group is likewise 
significant at the 5% level.*® 

The coefficients of correlation between the Co-operative 
and aural totals were .78 for the experimental group, and .47 
for the regular group. Tlie first figure is strikingly high, 
but the number of cases is very small. 

The foregoing data indicate that the 1945=1946 experiment 
in elementary French at College N succeeded in turning out 
students who could understand (and possibly also speak) French 
significantly better than conventionally tau^t students, but 
in so doing failed to develop their ability to read as well. 

Group lb. In 1945-1946 the experimental elementary course 
in French was repeated, with the substitution of Harris and 

35We report, for what it ia worth, that the experiaental (roup wax firem 
the wane forn (Lower A) of the aurai teat a aecond tine at the end of the 
year and nade a total mean acbre of 31.6 (8th tenth). 
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Leveque’s Conversational Frenchiac the Spoken French of Dcnoeu 
and Hall used the preceding year. Meanwhile the conventional 
course was divided into two groups using as texts , respectively, 
Micks and Longi’s Fundamentals of French and Lecompte and 
Sundeen’s Unified French Course. THie experimental group of 
fifteen students, as well as the full conventional group, were 
given both the Co-operative and the aural tests at the end of 
the year, each group at that time having accunrulated the same 
number of contact hours as in the previous year. Unfortunately 
the Co-operative scores had not yet been put at our disposal 
when we went to print, and we can only report the aural scores, 
which were as follows: 

AURAL 



MAY 1»4e (240 HRS.) 
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Group Using Ltcompte i Sundeen (N-il2) 
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2.9 


(4) 
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11.2 
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Til 


8. 6 


(5) 


T 


22.7 


(5) 



Experimental Group lb slightly surpassed Group la on two 
parts and on the total score, but this superiority could be 
the result of testing at 240 instead of at 200 hours. In any 
case Group lb also maintained a slight aural advantage over 
the conventional groups. 
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EXPERIMENTS AT THE HIGH-SCHOOL LEVEL 

What few experiments we know of at the secondary-school 
level in the development of ability to speak and understand a 
foreign language have not yielded concrete evidence on the 
effectiveness of the newer methods. In the normal high-school 
curriculum no provision can practicably be made for concentra- 
tion of time devoted to language study; the standard American 
teacher cannot suddenly be supplanted by a native speaker; 
indeed, within the inflexible high-school system any pressure 
to depart from traditional procedure is met with understandable 
resistance from administrators hard pressed to defend even the 
meager place at present conceded to foreign language study. 
Experiments have been, therefore, extremely limited in scope 
or duration. 

We report briefly on three such experiments, in the course 
of which our aural conprehensi<m tests were administered to the 
pupils involved. 

High School B 

In February, 1946, an experiment in the oral teaching of 
foreign language was undertaken in one of the high schools of 
a large city system. For reasons it is not necessary to 
enumerate here, the experiment was organized at the last 
minute, and lack of time prevented the formulation of strictly 
scientific procedures and the arranging of a clearly objective 
situation. Factors which minimized its scientific validity 
were the impossibility of grouping the pupils on the basis of 
I.Q. or prognostic tests; the lack of suitable texts and audio- 
visual aids, ' the absence of scientific control groups, and 
the ncm-existence of a detailed course of study. 

Ihe languages chosen were French, German, and Spanish, in 
each of which there happened to be two class sections of 
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beginners. In each case the section comprising the better 
pupils (on the basis of their general records) was designated 
as the experimental group, and the other as a control group. 
All six sections met during the same 37-minute period, five 
days a week. Three well -equipped, progressive and co-operative 
young teachers were selected from within the system, end under 
the circumstances the most that could be done in the way of 
planning the courses was to rely upon the resourcefulness of 
these individual teachers for the conception and practice of 
the actual techniques of oral -aural instruction. *(lhe German 
teacher was a native speaker, the others were not. ) 

Each of the experimental classes was supplied with a set of 
the Kany elementary conversation manuals. In addition, the 
B:ench group used Colette et ses freres, the German group Betz 
and Price’s First German Book, and the Spanish group Wilkins’ 
Primeros Pasos. The Kany manuals served as a model for 
simulated conversations, a model for copying, and a source of 
material for memorization. The readers were used (on an average 
of ten minutes in each class period) to cover the graitmatical 
points required of first-term students of the language, and as 
a basis for cfonversation on the stories and anecdotes read. 
There was considerable oral activity carried on in the class- 
room on a spontaneous basis, developed by the teacher as the 
occasion demanded. Much of this consisted, especially in the 
beginning, of questions and answers^ Later, pupils were called 

i 

upon to interrogate classmates, to give orders, to paraphrase, 
to dramatize, and to give brief descriptions or narrations. 
This sort of activity meant constant demands on the resource- 
fulness and energy of' the teachers, and it is reported that 
they acquitted themselves well. 

Enif^asis was placed on accuracy in pronunciation, although 

experimental aectiona contained forty-one pupila in French, thirty- 
aix in German, thirty in Spaniah. Control aectiona were of approximately 
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there was no resort to phonetic transcriptions; rather a 
method of practical phonetics was employed, with frequent use 
of the blackboard for illustrative purposes. English was 
theoretically banned from the classroom. Grammatical concepts 
were taught by means of gesture, circumlocution, analogy, 
comparison, and the like; frequent and continued oral practice 
was employed to enforce the new patterns. 

Otal and written tests were given at intervals to ascertain 
the progress of the students, and at the close of the term in 
June, all six classes were given the customary standard 
examination used in the system. €b this examination the 
experimental classes in French and German are reported to have 
performed considerably better than the control groups, while 
the special class in Spanish failed to achieve a higher 
rating. ^ ^ 

The experimental groups in the three languages were 
maintained throughout their second term the following year 
(fall of 1946 ), and at the end of that second term ten pupils^* 
from each group were given the Investigation’s aural compre- 
hension test with the following results: 

French German Spanish 

* 

LOWER A LOWER A LOWER A 





MEAN 


(TENTH) 


MEAN 


( TENTH) 


MEAN 


(TENTH) 


I 


4.1 


(6) 


10.6 


(9) 


8.7 


(10) 


M 


9.7 


(6) 


7.1 


(8) 


12.7 


(10) 


HI 


6.2 


(5) 


14.8 


(9) 


13.8 


(8) 


T 


20.0 


(6) 


32.5 


(9) 


35.2 


(10) 



These scores are measured against the secondary- school norms 
for two terms of study. The German and Spanish results are 
strikingly good in terms of our norms, but unfortunately the 

^^Much of the wording of the foregoing account of experimental inatruction 
at High School B is taken from a report prepared for an educational com- 
mission by the director of foreign languages in the city system. 

3^We do not know whether these ten constituted a random selection, or were 
the ten best. 
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corresponding control groups (if indeed they were kept intact 
at all during the second term) were not tested and we therefore 
lack data for comparing these levels of aural achievement with 
those of conventionally taught pupils in the same school. 

High School C 

In the 1945 Summer Session of a large city high -school an 
experiment was tried in the intensive teaching of French and 
Spanish at the beginning level. The purpose was to test the 
assumption that in a short period of highly concentrated study, 
which affords the necessary continuity of association with the 
language, pupils can be given a basic oral and aural command 
of the language in addition to a grammatical and reading 
knowledge equal to that gained by regular language pupils in 
the same amount of time spread over a whole school year. 

Studying no other subject during the summer session, the 
pupils met in language class four hours a day, five days a 
week, for seven weeks. Iheir total contact time was thus equal 
to that of pupils having four class hours a week over a 
school year of thirty-five weeks. 

The French and Spanish groups were under the full direction 
of their respective teachers and did not follow identical 
methods. 

Ihe French group had twenty pupils and one teacher (not a 
native speaker). She endeavored to use, and to have the pupils 
use, the spoken language as much as possible in class, but 
otherwise she relied rather heavily on the conventional 
procedures with which she had become familiar in the preparation 
of pupils for state language examinations. She used a conven- 



39ln ainottlier achool of the seme city system, certain groups in the same 
three languages were tested aurally* in April, 1947. It had been planned to 
provide during that year double periods for the instruction of third-year 
classes in one of the schools, but we cannot learn whether the groups tested 
in April were those particular third-year classes. The total means in French 
and German were within a very few points of those listed above; in Spanish 
the total mean was 10 points lower. 
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tional textbook, taught grammar inductively from it, practiced 
little if any mimicry -memorization, and used no audio-visual 
aids. 

The Spanish group had twenty-five pupils and two teachers — 
neither of t|iem a native speaker. The one in charge had ac- 
quired some first-hand familiarity with methods and techniques 
employed in the ASTP and in later experiments along the same 
lines at the college level, and he planned the course in such 
a way as to embody the main features of the oral-aural 
approach. He selected as a textbook LaGrone’s Conversational 
Spanish for Beginners , and to accompany this text he secured 
a set of phonographic transcriptions = recorded by a bilingual 
American professor of Spanish — of all the material in the 
book. For the introduction of new material in LaGrone, the 
class met as a unit and listened first to the recorded spoken 
version, imitating and drilling it chorally under the direction 
of both teachers working as a team. Only after they had become 
thoroughly familiar with the sound of the new material and had 
mastered its meaning in association with the sound, were they 
allowed to see the printed version. Grammar was taught in 
accordance with the functional treatment given it in the 
textbook; but the verb paradigms had been recorded along with 
the other material, and a goodly amount of time was spent 
( ill -advisedly, we feel) in the "mim-mem” of such utterances 
as "Tlive, tuviste, tuvo, tuvimos, tuvisteis, tuvieron.” After 
the presentation, initial mimicking and explanation of new 
material, the group was divided into two sections of twelve 
pupils or so each for further drill and conversation practice 
under each teacher separately. 

Both the French and the Spanish group took the Investiga- 
tion’s aural test (lower level) at the end of their seven-week, 
140-hour course. Ihe results: 
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French (Nb20) Spanish (Ns25) 

LOWER A LOWER A 





MEAN 


(TENTH) 


MEAN 


(TENTH) 


I 


6* 6 


(9) 


7.4 


(8) 


n 


8.6 


(5) 


10.0 


(8) 


HI 


6. 6 


(6) 


15.1 


(9) 


T 


21.8 


(7) 


32.6 


(10) 



Ihe scores are measured against the seccmdary-schooi norms 
for two terms of study. Ihe results from the Spanish group are 
seen to be excellent in terms of those norms; and while there 
is no proof of it, the possibility cannot be overlooked that 
the higher level reached by the Spanish than by the French 
group directly reflects the amount of aural proficiency 
teachable through each of the rather sharply contrasf;::.g 
approaches used. 

No specific information was available to us on the success 
of these experimentally taught students in their second year 
of conventional high-school language study. 

High School D 

In a small hi^ school an experiment was carried out during 
one year (1945-1946) with a group of first-year French students. 
The purpose was to test the effectiveness of one of the 
currently available courses in which conversation is tau^t 
throu^ the use of phonograph records. Ihe group of seventeen 
pupils was divided in half, both taught by the same instructor. 
During the first semester, Group A worked with the phonographic 
materials while Group B was taught by a conventional grairanar- 
translation method. The two groups met the same number of 
hours per week. During the second semester the methods were 
transposed: Group A moved over to grammar -translation, and 
Group B used the records. Both groups took our lower-level 
aural test at the end of each semester, with the following 
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scores 


for the 


total test: 






FIRST 


SEMESTER 


SECOND SEMESTER 




LOWER A 


LOWER B 




MEAN 


(TENTH) 


MEAN 


Group A 


21.1 


(7) 


20.2 


Group B 


14.5 


(4) 


13.4 



While the difference between the means at the end of the 
first semester did not prove to be significant, that existing 
between the means on the second test is significant at the 1% 
level. No data were available to us on the intelligence or 
general linguistic aptitude of the pupils forming the two 
groups, and in the absence of such data we cannot advance any 
theory to explain the significant difference in. the end results 
that would not leave several variables out of account. If the 
difference had been significant at the end of the first 
semester, before the methods were shifted — or better yet at 
the end of both semesters, — some support might then be found 
for the hypothesis that an initial approach through the 
spoken language serves to develop a higher aural facility 
(shown here to be retainable even after a shift of emphasis to 
visual skills, cf. Group A) than can be attained in a situation 
in which the emphasis is first visual and or. ly later oral- 
aural (Group B). 

Summary 

Since the work of these experimental groups was a point of 
cardinal interest to the Investigation, the summary of their 
procedures and results forms a major part of our general 
ccmclusions in Chapter VIII. 



Chapter VII 



The AdvaMced Level of Language Skill: 
English as a Foreign Langnage 



Tbe Investigation was particularly fortunate in being able 
to study language learning at an advanced level. Usually such 
study is not possible . In American institutions few students 
continue beyond the second or third year of foreign language 
work; and for those who do, advanced work tends to emphasize 
literature, historical linguistics, and other matters rather 
than the linguistic skills. Our work at the advanced level 
was, consequently, not with the usual "foreign languages" but 
with English taught as a foreign language to the mainy foreign 
students who have come to the USA during the past few years. 
The Investigation profited from the opportunity to observe 
this work, and we believe that all language teachers can 
benefit from considering it, Ihough a different medium is 
involved, many of the basic problems of language teaching at 
the advanced level are the same. When these issues are stated 
in terms of one*s native language, many of them become clearer 
and are less likely to be decided on the basis of habit or 
tradition. 

In America the teaching of English as a foreign language 
had long been neglected and even scorned. Though valuable 
work had been done for immigrants and other groups, it was 
usually carried on under adverse conditions by teachers who 
were Undertrained, ■ underpaid, and overworked. This situation 
began to change markedly even before the second world war. 
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American advances in various technologies brou^t increased 
numbers of foreigneirs to work and study in American univer- 
sities, hospitals, social agencies, and governmental bureaus. 
With the coming of the war, the closing of the European 
universities and the inauguration of training programs for the 
armed forces of our. allies brought still more. The postwar 
influx has been equally large. 

These students did not labor under the handicaps of ad- 
vanced age, low I.Q., or inferior educational, social, and 
economic status as did many earlier students of English. Still 
more important, instead of being isolated in the slums of our 
cities, this new group was thrust upon the attention of insti- 
tutions and agencies which had resources in trained personnel 
and other facilities far beyond any heretofore devoted to 
English teaching. Skilled language teachers and linguists 
either found themselves confronted by this new problem on 
their own campuses or were called in by various agencies to 
help. As a result, there has been a degree of interest and a 
variety of experiment approaching that called forth ir the 
foreign- language field by the Army Specialized Training 
Program. 

Many of these students come with little or no English; but 
probably the majority of them have completed two to four 
years of English in high schools or colleges in their native 
countries. They thus represent approximately the next linguis- 
tic level above that covered in the preceding chapters; and 
their problems are those which our American' student will 
meet, if after completing the two or three-year course, he has 
the opportunity of living and studying in the country whose 
language he has learned. 

Work at this level has a note of realism which is impossible 
at the earlier stages. What skills and how much of them a 
student should have at the end of 100 or 200 class-hours of 
college French must be a somewhat arbitrary judgment. In the 
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case of these students, however, the amount of language they 
need is obviously what they must have in order to carry on 
their work here. This pragmatic test offers some basis for 
standards, but it is complicated by a number of factors (mfsny 
of which are equally operative in the case of American stu- 
dents of foreign languages at this level). 

The first is that these students vary enormously in the 
amount of language they need to get along and in the relative 
command of each of the basic skills which they must possess. 
This variation is a function of the different uses which these 
students have for language as a result of the vocational 
fields in which they work, the types of activity involved, 
the conditions under which they live, and the like. For 
example, the foreign student who lives in a community of 
his compatriots and who works in a laboratory, running 
experiments and recording the results in numerical or chemical 
symbols, may get along with surprisingly little English. 
On the other hand, the student who must deal with American 
clients and patients, who must cover long lists of assigned 
readings in English, or who must follow university lectures, 
will need a rather extensive knowledge of the language. 

As the preceding examples imply, there will also be some 
variation in the amount of each skill the student needs. Some 
will need great ability in reading and writing but will have 
relatively little call to speak or understand. Conversely, 
others will need primarily aural-oral skills and little else. 
Obviously then, no single standard of achievement can be set 
for all the group, and one of the first problems is to define 
needs of various general classes of student. The county 
agricultural agent or the foreman on the assembly line may 
have a very different standard, but in its way, a no less 
difficult one than that of the English professor. With 
certain exceptions (which will be indicated), however, we have 
based our findings on those who will be "students". 
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A second important variable is the amount of allowance which 
Americans will make for the foreigner in his attempt to cope 
with English. Some agencies, institutions, supervisors, and 
instructors will make great concessions. Others will adopt a 
a sink-or-swim policy. In smaller organizations more personal 
allowance is possible, and in some places standards are not 
so high, llhere the foreign st 'dent needs much less English. 
For one reason or another, however, foreign students tend to 
affiliate with the larger agencies and institutions — exactly 
the places where the least individualization of treatment is 
possible, where the demands are greatest, and where the 
native students are most talented. If one attempts to equate a 
specific level of performance by certain students with 
judgments as to whether or not these students' English is 
satisfactory, one finds the greatest disparity of judgment 
regarding similar cases-»and sometimes even in regard to 
the identical student.^ Frequently it is clear that the 
difference lay in whether the judge asked himself, "Does this 
person do all right for a foreigner?" or "How does he compare 
with the rest of my students?" 

This point leads to the third, that many factors other than 
purely linguistic ones are involved in the selection, handling, 
and evaluation of foreign students in this country. We should 
not be so foolish as to maintain that linguistic considera- 
tions should be the sole criterion, or even the major one, in 
selecting students to come to this country or in determining 
their programs while they are here. On the other hand, we 
believe the other point of view is fallacious (even though it 
seems frequently assumed) : that the achievement of our present 
students, whose selection and training is largely determined 

^E.g., two atudenta who had the higheat teat acorea recorded at one 
training center during about a year were later reported by a large inati* 
tution with very high atandarda aa poaaeaaing inadequate Engliah. Other 
atudenta, from thia aame Center and working in the aame field, were thought 
by other universitiea to poaaeaa aufficient Engliah though their knowledge 
waa far inferior to that of the other two. 
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by political, social, and other factors here and abroad, 
should be taken as representing what is linguistically 
feasible, desirable, or inevitable. We may well . ’ to con- 

sider language as only one of a number of factors; but if we 
do so, we should not deceive ourselves as to what vie are 
doing. Theoretically, it would be pleasant if we could settle 
the linguistic questions free from all other considerations. 
That situation is not likely to be available. Therefore we 
can only remind ourselves, in attempting to determine stan- 
dards, that our present students, the length and type of 
training they receive, the conditions under which they have 
it, and a number of other matters are determined on non- 
linguistic grounds. 

Another question involved in setting standards for this 
"ability to get along" is whether "intelligibility" may be 
accepted as a substitute for "correctness." The following 
paragraphs taken from a theme submitted by a foreign student 
illustrate the point: 

Many year ago, when I waa a youMg boy, it came to my mind the 
idea to visit some day the United States. At this time, I couldn’t 
expect that I really should come to this country. The idea came 
probably to my mind through the influence of the movies where people 
are informed about America. Meanwhile I was poor and I had many 
handicaps to fight. Fortunately I increased my education and in 
1936 I got my Degree in Law. 

When I was studying at the School of Law I felt the necessity to 
learn English in order to read some books about Constitutional Law. 
American and English books, besides French, are the best in thi.s 
subject. I conceive the idea to improve the preliminary knowledges T 
had had at the high school. 

Then I began to read with the help of a good dictionary. At the 
beginning I had too much troubles, specially when 1 found some 
descriptions of the American way of life. But I was deeply inter- 
ested in the subject and as much as I was reading or going deeply 
in my readings. I was liking both the English language and the 
American way of life, specially the American ideas about Democracy. 
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At this time, my wishes to know the United Ststes had increased so 
much that I couldn't complain with the idea of never to come to this 
country. 

Alrx)st every line has at least one example of "bad English, " 
not by the more pedantic rules of good usage, but in the 
fundamental structure and vocabulary of the language. On the 
other hand, it is doubtful whether any native speaker of 
English who would be in a position to receive such a com- 
munication would have the slightest doubt as to what was 
meant. In its context, even "complain" is clear. Shall we say 
that this student has committed scores of serious errors 
within a few lines and that his English is poor? Or shall we 
say that he has communicated his meaning well enough? As a 
matter of fact there is na doubt that the complete theme would 
receive very diverse grades at different American colleges, or 
from different professors in the same school. 

The chief difficulty with taking intelligibility as a norm 
is that it will be a very fluctuating one. For example, the 
American well disposed toward the foreigner, familiar to some 
extent with the latter's native language, and fairly ingenious 
at guessing meanings, will understand much more than the 
person who is convinced, even before the foreigner begins, 
that he will not be able to understand him anyway because 
all foreigners talk and write gibberish. 

Another of these complicating factors is the inter** 
linguistic nature of many skills. These abilities tend to 
operate to about the same extent in all languages with which 
an individual works. The student who cannot remembisr a lecture 
which he has heard in his own tongue is unlikely to do better 
when he hears it in a foreign one. The person who writes his 
native language with no capitalization and in incomplete 
sentences or who is unable to organize a paragraph is not 
likely to learn these niceties while he is also struggling to 
master English. We acquired, rather incidentally, considerable 
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evidence that in these respects foreign students are often far 
from competent in their native languages. Yet can we hold 
students to standards in English which they cannot attain in 
their native language; and can any training center hope to 
give all this and English too? Ihese factors make it difficult 
to determine exactly what level of English the foreign student 
should be expected to master and these complications must be 
kept in mind when one examines the following data. 

To ask foreigners to compete on exactly even terms with 
natives is to expect too much. But obviously, if the foreigner 
is to profit from his stay in this country, the linguistic gap 
between him and the native must be as sli^t as possible. Had 
a series of basic tests for all skills been in general use 
with native students, these would certainly have been the 
ones we used for testing the foreign students. Both groups 
could then have been measured by a common scale, and the 
abilities of various foreign groups could have been directly 
compared with existing norms for native speakers. Unfortu- 
nately, no such series of tests was available, and even the 
single instruments in common use in American colleges did not 
lend themselves to this purpose. 

The available reading tests suffered from several draw- 
backs. Those which called for only a literal understanding of 
a passage were too infantile in content; the more advanced ones 
were too heavily weighted by items demanding inference and 
other inter -linguistic skills and gave too slight attention 
to that literal comprehension in which we were most interested. 

9k- 

Sections of poetry, for which the foreign student generally 
could not be held responsible, made other tests unsuitable. 
In the field of aural comprehension we could find nothing. 
This neglect furnishes interesting commentary on our higher 
education. Reading tests regularly form a part of the examina- 
tions given entering students by most colleges on the sound 
theory that the student who has difficulty with reading will 
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be unable to handle the assigned lists, bibliographies, and 
tests. Yet it is assumed that all students are prepared to 
cope with the many hours of lectures and discussirais to which 
they listen. Remedial reading is a familiar phrase on every 
campus, but remedial listening has yet to appear. Audiometer 
tests are given, but they are equivalent to the use of an 
eye-chart as a reading test. Writing and grammar tests, in 
their turn, either called for niceties which should not be 
demanded of the foreigner or else were loaded with dubious 
items of correct "usage." For oral production (as opposed to 
oral composition or speech delivery) naturally nothing had 
been needed for native speakers. 

In view of these difficulties, no alternative appeared to 
constructing our own set of tests. ^ Apart from the delay and 
labor involved in construction, this procedure necessitated 
gaining further data regarding the performance of native 
students on these tests. These data would plainly be difficult 
to secure; but under the circumstances, no other course 
seemed possible. 

We began our search for standards and our construction of 
tests with the assumption that most of the existing standards 
tended to be too low. We came to this conclusion from having 
noticed the difficulties of foreign students at our own 
university, students who had been cleared by various training 
centers but who were, none the less, proving deficient in 
English. Our emphasis on higher standards here and in later 
pages should not be interpreted as disparagement of the 
training centers. When a person is on a long journey, it is 
quite possible to take him a considerable distance and still 
not convey him to his destination. The standards q^ many 
centers were, moreover, determined by the type of student 
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they had, the length of time they were given for this training, 
and other factors over which they had no control and which, 
as we have already pointed out, were non- linguistic. Certainly 
there have been too many situations in which the length of 
training has been determined only by the time available 
between the date of the student's arrival in this country 
and the opening of his school or job~a period sometimes 
measurable in hours! 

This situation can be illustrated at once if we turn to the 
first of the Investigation’s tests, the Elementary Structure 
Test. This was prepared by Miss Hazel Mitchell during the 
time she was working at the central office as representative 
of the English Language Institute in Mexico City. The test 
was originally prepared to cover the first year’s work in 
English as it was then given at the Institute and was intended 
for use there. When the test was available, however, several 
other instituticHis asked to use it, and we ended by taking it 
over for general distribution. 

This test differed from our others in that it was pitched 
at a very elementary level. Within an extremely limited 
vocabulary it covers the syntax of the most elementary English: 
the formation of plurals, use of pronouns, sentence order 
in statements and questions, and the like. These are the 
elements of English as taught in a first-year course in a non- 
English speaking country. Yet this test was accepted as 
representing the level at which many students were when they 
entered centers for further study. As will be seen from the 
following table, the students who have taken this test, most 
of them shortly after arrival in this country, generally do 
fairly well. But we must not lose sight of its elementary 
nature. Tbough comparisons are difficult, if not impossible, 
it probably represents a level of difficulty somewhat below 
that of the grammar sections of the Advanced Forms of the Co- 
operative Tests, which we used for the foreign languages. 
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And one who is familiar with these tests will doubt whether a 
high score on them indicates th&t the student would succeed 
in working in France, Germany, or a Spanish -speaking country. 
In fact, some very rough approximations we worked out in 
connection with our own group at the University of Chicago 
seem to indicate that a score of about 135 (or 90%) on this 
test indicates— not that the student has a command of jEhglish— 
but that he has a good grounding and is in a position to 
profit from further instruction and practice in this country. 

ELEMENTARY STOUCTURE TEST 
(151 items) 



Decile 


Scores 


9th 


145 


8th 


138 


7th 


131 


6th 


125 


5th 


118 


4th 


107 


3rd 


99 


2nd 


84 


1st 


69 


Mean 


115.84 



Baaed on the scores of 205 students in five training centers. 

Heading is an important skill for these visitors. For- 
tunately it is one in which most of them are well prepared 
when they come. Heading is the skill in which they have had 
the most practice and which suffers least from being taught by 
a teacher whose acquaintance with the foreign language is 
slight. 

Several desiderata controlled the construction of the 
reading test. One was that the materials should approximate 
the level of college reading. When the passages had been 
selected, they were reworked by five members of the staff, 
four of whom were experienced teachers of English to for- 
eigners. Though we wanted to keep the material in its original 
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state, a few changes were made in features that appeared un- 
fair to foreigners; some rare words, unusual idioms, and 
uncommon sentence patterns were replaced by their more 
frequent equivalents. On the other hand, some rather uncommon 
words and structures (the meanings of which were derivable 
from the general context of the passage) were retained to 
give a note of realism to the reading. None the less, the 
materials have been slightly simplified below the level at 
which these students are asked to read for their work. 

It also seemed desirable that the passages should be of 
fair length, approximately 250 words. When passages are of 
this size, few can appear in a single test. Hence the student 
is less certain to find among the small number of passages one 
which appeals to his personal interest and background; none the 
less, the. realism obtained -by forcing the student to work 
through several paragraphs of continuous material seemed to 
offset these disadvantages. 

Another desirable feature seemed to be to make the students 
work with some speed. Many people can read a foreign language 
if they are given enough time to dig out each word and phrase 
in. the dictionary and grammar. This procedure is completely 
impossible for the foreign student who must cover reading 
lists, case records, and the like. TTbough many of them are 
willing to devote additional hours to make up for their in- 
evitable handicap, eventually the twenty-four hour day comes 
to an end, The foreigner is likely to bog down unless he can 
read with some ease. 

Selection of topics for the passages presented the usual 
problem. Many, studies 3 have shown that , the reading skill of 
native speakers varies in relation to the kind of material 
read. If one believes that "English for automobile mechanics 

^£•§•9 F. P. Bobinson and P. Hall 9 '^Studies in Higher Level Beading 
Sicilia," Journal of Educat ional Ps ychology , XXXII (1941) 241-52 and A. S, 
Artley, "The Appri^iisal of Beading Comprehension," ibid., XXXIV (1943) 55-60. 
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specializing in carburetors" is possible, then a student can 
justly be expected to read only in his field of specializa- 
tion. We did not believe that language could be so easily 
compartmentalized, though this is a point to which we must 
return later. Even if it could be, the foreigner in this 
country will probably not find all his reading centered 
narrowly around his specialization. Consequently, the reading 
passages contain the type of material likely to be found in 
non- technical articles on current affairs and American life, 
and were drawn from two books and two magazine articles. 



READING COMPREHENSION 
(41 items) 



Decile 


Scores 


9th 


31 


8 th 


26 


7 th 


21 


6th 


17 


5th 


15 


4th 


11 


3rd 


8 


2nd 


4 


1st 


1 


Mean 


15.44 



Based on scores of 250 students in five training centers. 

The level of achievement is not high. The average student 
scores considerably less than half of the total number of 
points possible. But since the examination is not simple and 
since the student works without the dictionary and other aids 
which he would usually have, these results do not demonstrate 
the need for higher standards as clearly as do some which 
follow. 

Aural comprehension is also an important skill 'for the 
foreign student; but, in marked contrast to reading, it is 
the one in which he usually is weakest. This is the form 
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of English with which he has had least contact, and certainly 
the sounds which issued from a teacher who spoke English with 
a marked foreign accent bear little resemblance to those 
which he hears uttered by native speakers. And those Americans 
talk so fast and swallow half their words! 

THie desirability of having a formal test of aural compre- 
hension can hardly be overemphasized. We have often heard 
teachers say that they could tell more by three minutes of 
interview than by fifteen minutes of test. There is con- 
siderable room for self-deception in this regard. As anyone 
knows who has used a foreign language, a "yes" and a smile at 
appropriate intervals, or a noncommital comment can often give 
the impression of satisfactory comprehension when the actuality 
has been far otherwise. Experience we have had with students 
whose comprehension has been certified on the basis of inter- 
view has made us extremely dubious of this procedure. 

The selection of passages for this test involved much the 
same problems as those for the reading examination. We con- 
sidered it extremely important that the passages offered 
should be long — in this case four to five minutes each. It is 
not enough for the student to be able to distinguish the 
individual phonemes, words, or sentences.^ In fact, even 
the ability to understand two or three consecutive sentences 
will not carry him far. As any one of us knows who has ever 
tried to understand a foreign language, it is easy to follow 
utterances of a few words. One’s auditory memory can easily 
retain that amount of material, and it can be mulled over if 
not understood as heard. Continuous discourse is much more 
difficult. The hearer feels he is being inundated by continual 
waves of sound. If he tries to stop and puzzle out the first 
sentence or two, he completely misses the next four or five. 

^The d ifference in performance on the Phonetic Accuracy section or the 
short- definitions and completionSi as compared with the longer anecdotes and 
dialoguea, has demonstrated this point in the foreign language tests. Cf. 
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The native speaker, particularly the college professor, is 
usually not so thoughtful as to speak in phrases (or even 
groups of sentences) with long pauses in between. As the 
correlations on the foreign language tests show, students 
can understand single utterances without being able to cope 
with the full flood of speech as it pours on them. We have no 
quarrel with aural comprehension tests which involve simple, 
short materials. For placement, for practice, and for progress 
testing, tests of this type rather than ours should certainly 
be used. But we believe they are grotesquely out of place as 
final measures of the ability to comprehend the spoken 
language in anything but the most Pickwickian sense. 

llie importance of this skill for the foreign student has 
already been emphasized by our colleague, Hugh R. Walpole: 

The foreign student must read well, write understandably, and 
comprehend the Englifih that he hears. He can, if need be, take 
longer than his fellow-students over his reading and writing. 
Listening time, however, is strictly limited; for he cannot at will 
turn the professor back and listen to him again. In aural compre- 
hension he must be up to native standards.^ 



The scores made by the foreign students 



tested were as 



follows: 



AURAL COMPREHENSION 
(44 items) 



Dec iles 


Scof^es 


9 th 


27 


8th 


24 


7 th 


21 


6th 


19 


5th 


16 


4th 


13 


3rd 


10 


2nd 


6 


1st 


1 


Mean 


15.56 



Based on scores of 112 students in five training centers. 

5H. R. Walpole, "How Much English Must a Foreign Student Know?" the 
School Review, LV (1947), 231. 
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Consideration of these scores, which reveal that only a 
third of the students get even half the items right, naturally 
raises the question, "How well do native students do on these 
tests?" lliis same question comes to mind in regard to all the 
tests, hut this is the only one in regard to which a valid 
answer is likely to be obtainable. The other tests are just 
too simple for American college students to take them seriously. 
In grammar, tests, for example, the American student is 
accustori«d to being harassed with problems like "The man (who? 
whom?) I think will be elected is popular" and "The number of 
possible answers (is? are?) small." He is used to puzzling 
over these problems and disgracing himself by his choices. 
But confronted by "I arrived there (on? at? in?) Saturday," 
he thinks that the instructor is crazy or is pulling his leg. 
The native speaker simply has no question about items like 
this. If he makes a mistake., it is usually due to clerical 
error caused by carelessness or perhaps it results from the 
kind of confusion which afflicted the centipede who was 
asked which leg he moved first . The reading test is only a 
little better in this respect. The native college student is 
used to reading tests which demand soma penetration. But when 
he sees be. ore him in the test "The traders pressed forward 
following . . . the Mississippi, the other great rivers . . ." 
he can, complete the statement "The rivers — were the routes 
by which the traders penetrated the country." Few American 
students who have reading difficulty at this literal level 
manage to enter college. As a result, only the test of aural 
comprehension offers enough novelty- and difficulty for us to 
have any hope that the native student will take it seriously. 

This attitude of the student (whether native or foreign) 
toward the test is, of course, of fundamental importance. 
Tests are delicate instruments and are no better than the 
situation in which they are used. Some of our friends were 
very co-operative and administered the aural tests to groups 




of native students. In most cases, however, they could not 
produce an actual testing situation. The Americans were not 
taking tlie test as they did their other examinations i.e., 
as an important factor in determining their grade for a 
semester's or a year's work. The test is too simple to be 
even a kind of parlor game, the sort of interest which makes 
it possible to use otherwise unmotivated subjects in psycho- 
logical experiments. The results obtained from such situations 
are hardly comparable with those to be expected under normal 
test conditions. For example, one native American made a score 
of 8; but he answered only the first eight questions and then 
apparently lost interest, trying no more items.® 

Only one native group took the test under approximately 
normal test conditions, and these were students in an "awkward- 
squad, " a section of college freshmen who were having language 
difficulty and had been placed in a remedial course. It would 
seem that the level of achievement attained by a group of this 
kind would give a fairly realistic picture of the kind of 
standard we must visualize for foreign students. Unfortunately 
the group was small, and certainly this evidence should not be 
regarded as conclusive. None the less, a comparison of its 
results with those of the foreign students is not without 
interest: 



Decile 


Native 

Students 


foreign 

Students 


9th 


40 


27 


8 th 


38 


24 


7th 


36 


21 


6th 


35 


19 


5th 


34 


16 


4th 


34 


13 


3rd 


32 


10 


2nd 


30 


6 


1st 


28 


1 



; "'•y that some of the scores reported here for foreign st’idents 

^ are also too low for similar reasons, though we have no cause to think that 

such was the case for any students included in these norms. 

} 

I 

j, 

f 
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The contrast between the two distributions (in which only the 
9th decile for the foreigners is up to the first decile of the 
natives) requires no conment. 

Tbie writing skill was measured by a double test, IVriting and 
Structure . In the first part, the writing test, the student 
was required to manipulate very simple materials actively. He 
y/as given a brief anecdote to read and was then asked to write, 
without access to the text, the answers to ten simple questions 
on the story. In the second section of the writing test he 
was asked to describe meiTibers of his family and to tell how he 
had spent the preceding Sunday.*^ 

The structure part was in multiple -choice form. In ninety- 
five items, the student was required to select the correct 
word or phrase out of the three offered. These items formed 
part of a continuous narrative, the description by a foreign 
student of his arrival in the United States. We believed this 
would be a topic with which every foreign student would be 
familiar. Objection is sometimes made to tests of this type 
on the grounds that, for the foreigner, they may degenerate 
into puzzle-solving; instead of expressing ideas in his own 
way, he has to fit the proper bit of English into a hole in 
^ the context , judging the fit by sense and syntax. We sought to 
avoid that difficulty by making the correct answers the most 
normal and commonplace English. Aside from agreement in number 
and tense of the verbs, the items do not depend on this kind 
of maneuvering. 

As was to be expected, the correlation between the scores 
on the two parts was relatively high.® It might have seemed 
hardly necessary to administer both types. Studies of the two 

7 

An avernge paper on this test is reproduced a few pages later. 



*0n a sample of 19U papers from seven institutions the coefficient was 
.70. The digtr ibut ion wai ^ howeVeLr, obviouily curvilinear and the correla- 
tion ratios were .73. and .86, The latter of these (structure on writing) 
was greater than the coefficient by an amount significant at the 1% level. 






\\ 
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types with the compositions of native students^ have shown 
that the objective test is an equally valid and certainly* a 
much more convenient measure. But several features of the 
foreigner’s situation suggested that the cases were not 
exactly parallel and that both sorts of test should be tried. 

In general, the structure test is highly reliable and a 
better predictor of performance in the free writing test than 
the latter is ,of it. The explanation of these facts is fairly 
clear. In writing (particularly in regard to the simple 
material required in this test), the student can often do 
fairly well by carefully keeping within whatever small amount 
of English he knows; by using baby sentences, he can stay out 
of complications. This device is a handy one for anyone 
learning a strange language and should certainly not be 
penalized. One wonders, however, whether the student is equally 
careful when he i$ not in a test situation. A more dubious 

practice (but one in which every language learner tends to 

. 

indulge) is just not to try to say what he isn’t sure of 
being able to say correctly. The tests written on this prin- 
ciple are extremely laconic. Although this may be a. means of 
doing well on tests of free composition, retribution strikes 
when the student later follows this plan in preparing papers 
in other subjects; the instructor has no means of guessing 
whether the student is just being coy in English or whether 
he doesn’t know much about the subject. In short, for general | 
testing purposes, the objective (i.e., structure) section is | 
probably the more useful-, but individual differences appear [ 
if the composition test is also used. 

The following table shows, the performance of a fairly | 

large sample of students on both sections of this test. I 



J. B. Enochs , iVea* ur ing the Ability to Vrite. (Unpublished 
doctor's thesis. Unirersity of (Chicago) 1946. 
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WRITING AND STRUCTURE TESTS 





Structure 


Writing 




(95 items) 


(100 point scale) 


Dec i le 


Score 


Score 


9th 


78 


84 


8th 


67 


79 


7 th 


57 


73 


6th 


49 


68 


5 th 


44 


62 


4th 


31 


58 


3rd 


22 


53 


2nd 


12 


47 


1st , 


4 


36 


Mean 


40.62 


61.42 



Based on the scores of 197 students in seven centers. 



These scores were all made by students nearing the end of 
their training programs. It is, of course, impossible to 
judge how many of them will stay on (either by choice or 
force) for further training in English before taking up other 
work. The reader will be able to Judge for himself what would 
be desirable by examining the writing test of an average 
student, which is reproduced below. 1® Fifty per cent of the 
students tested did worse. 



TEXT FOR PART I 

DIHECTIONS: Read the following story carefully. After five minutes 
it will be taken away from you, end you will be asked to answer a 
few questions about it in writing. 



lOThe writing teats for final recording purposes were all re-read by one 
oaesber of the staff using the same scale. The differences between his scores 
and those of other staff members who read the papers were negligible (nerer 
exceeding two points) but this technique eliminated even this slight vari- 
ation. This student's score of 62 is close to the mean of 61 and median 
of 62 . 



i 
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Two Old Ladies in a Street-Car 

It was wintertime and it was very cold. Two old ladies got on a 
street-car. They sat down near a window. Ohe of them got up from her 
seat, opened the window, and sat down again. The other one, furious, 
got up, closed the window, and sat down again^ 

The first lady: - Conductor! Open the window! I don’t want to die 
from lack of air! 

The second lady: - Conductor! Close the window! I don’t want to 
die of pneumonia either! 

The poor ccnductoi did not know what to do. He wanted to please 
both ladies. He wanted to keep them both from dying. But it was 
impossible; one wanted the window open, the other wanted it closed. 
How was he to solve such a hard problem? 

While the conductor was thinking of a way out, the two ladies 
started arguing in loud voices. The noise disturbed everybody in the 
street-cac. 

"Conductor! Ihis business can’ t go on forever! We must do some- 
thing! " cried one of the passengers. 

"But what can I do, sir?" asked the poor conductor, hoping that 
somebody would give him advice. 

"First open the window, and one of the ladies will die of 
pneumonia. After that, close the window, and the other one will die 
from lack of air. Once they are both dead, the street-car can go 
peacefully on its way." 



DIRECTIONS: You are to anjswer the following questions about the 
story which you have just read. Write your answers in the blank 
space below the questions, numbering each answer correspondingly. 
Write a complete sentence for each answer. You have ten (10) minutes 
in which to finish Part I. 

1. What season of the year was it, and how was the weather? 

It vas winter season and the weather was very cold. 

2. What did the two ladies do? 

The two Indies went into a street-car, 

3. Where did they sit? 

They sit near a window. 

4. What did the first lady do? 

She closed the window. 

5 . And the second? 

The Sircond lady Opened the window. 
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6. Whom did the first lady call, and what did she say? 

She call the conductor in order that he closed the window 
because she didn't want to die by lack of air. 

7. And the second? 

The secon call the conductor too, but she wanted the window 
close because she was afraid of die by a pneumonia. 

8. What did the conductor do? 

The conductor start to thinking of a solution. 

9. What did the ladies do while the conductor was thinking? 

The ladies continued arguing in a loud voice. 

10. What did a passenger suggest? 

To kill both ladies. 



PART n 

DIRECTIONS: You are to write five sentences about each of the 
foil owmff thcincs • Use bl&nk sp&ces provided!* You will heve 

fifteen (15) minutes to finish Part H, 

A. Describe the person and occupation of each member of your family. 

1. My father is a Bank’s nnansj^^er. 

2. My mother takes care of home and works at her free time in my 
father’s business. 

3. I have two brothers and they are studying. 

4. My junger uncle works to a oil company. 

5. My older uncle works to my country’s government. 

B. Tell in detail what you did last Sunday. 

1. As every Sunday I waked up about eleven thirty. 

2. At noon I went to eat my lunch where I u^e it. 

3. After I ate come back home and spent about three hours reading 
a novel. 

4. At four o’clock I took a bath, then I dressed up and went out 
to the movies. 

5. After show I eat my supper and went home to study until middle 
night. 



To summarize our conclusions from these data and what we 
have observed, the first is that the standard of English for 
foreign students should be kept k gh. In many cases this 
decision will mean that it will have to be raised. We believe 
that the evidence here presented, limited in scope though it 



268 AN INVESTIGATION OF SECOND- LANGUAGE TEACHING 

is, indicates that a higher standard is desirable. For the 
reasons pointed out at the beginning of this chapter, the 
establishment of the necessary relation between performance 
during training and success in later use of the language will 
always be difficult to secure; but additional data would 
certainly be desirable. 

-If the matter still appears debatable, however, it would be 
better to err on the side of too hi^ a standard rather than 
too low. Only with such a high standard will we really do 
justice to foreign students^ They are human beings as well as 
bearers of tuition and grants -in- aid. The students come with 
a feeling of responsibility. The opportunity for study in 
America is their "great chance, " and they are under con“ 
siderable pressure to justify the confidence placed in them 
by their governments, families, or others who have made their 
coming possible. Coming from different educational systems 
and having to adjust to a foreign culture, they face enough 
problems without having too great linguistic difficulty. Of 
necessity they will labor under linguistic handicap; the best 
we can do for them is to make certain that it is as slight as 
possible and to reduce the amount of disappointment and 
failure by requiring a high level of achievement when they 
are accepted for ajtudy here. 

Severe pressures work against such standards. Quick cures 
for anything are always popular. The student with an opportu- 
nity for study in Atnerica will be inclined to seize the chance 
and hope that i he can fix up his Biglish in a hurry. Anyone re- 
sponsible for bringing foreigners to this country will prefer 
to believe that a couple of month* s work here will do the 
trick and that ample time will then, be free for other work, 

, But any grdat optimism' in this regard seems to us to rest 
on an undue minimization of the great gap between elementary 
Binglisii and fjiull English. A number of different procedures 

liCf. pp. 249 ff. 



\ 
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have been developed for teaching English at the elementary 
level, and often bitter rivalry has sprung up between their 
advocates. Despite the differences which are usually stressed 
and defended strenuously, all these procedures follow a 
generally similar plan. 

They consist of the "most useful" vocabulary of 850 to 
2,000 words and the "most useful" sentence-patterns and 
structural features. "Useful" is generally defined as that 
selection of English vocabulary, structure, or syntax which 
will enable the student to express' the most things — * usually, 
to express everything. In some cases, the passive skills of 
reading and listening are also considered; in that event 
frequency of occurrence in English is also taken into account 
(as well as usefulness or coverage) so that the student will 
command the words, forms, and cons true tims which he is most 
likely to encounter in oral or written form. As Fries and 
Traver have shown in regard to vocabulary, there is con- 
siderable overlapping between the vocabularies of these 
Systems, and their other features show the same similarity. 

Since We have mentioned these systems, we may digress for 
& Bnontdi tt o speak to a question often asked of us in the 
course of the- Investigation. Which of these systems is the 
best? This is an acute, practical problem for any person 
charged with elementary English instruction. Shall he adopt 
this system with its accompanying texts, or that one with its 
texts? At first glance it might seem that some direct com- 
parison should be possible to determine which of them teaches 
"elementary 'English" most effectively.^^ A momept’s reflection 



C. Frica and A. A. TraTer, Engligh Word Littt. (W^ahington: American 
Council on Education, 1940 ). 



iSpor our intereata here the queation whether aome of /theae ayatema are 
tp j^iervp as sn intsrnstionsl auxiliary language is irrclcyante 
We are considering them here only as stepping«stones to full English. Taking 
up the other question (which lies just outside the scope of this book) 
merely obfuscates the present question. 
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reveals that such comparative judgments are impossible. Each 
o:i; these systems defines "elementary English in terms of 
itself. " What it contains is, for it, "elementary English." 
In spite of the overlapping already mentiored, theie are items 
of vocabulary and everything else which are unique to it. A 
Gcmnon measuring device is hardly possible practically. And if 
one can be made which limits itself to those, elements common 
ito all systems, it would be open to objection on . theoretical 
grounds since it would probably be forced to ignore larger 
^portions of many systems than^ it could include. The systems at 
5 this level are^ incommensurable.^^ 

For our present purposes, we should not be too interested 
in, this level, . for, we , are considering these .systems not as 
"little lan'guages" but as means to full English. 'The proof of 
effectiveness should then, be obtained by comparative study at 
the level of.'.fuli English, not' within the limited elementary 
system. For this purpose experiment would cover several com- 
parable jgroups of students. They would begin" their study of 
English ,;by means of one of these, elementary systems and move 
throughjiit to experience with a variety of materinls-in full 
English,,^ Then,, at the, end of ■ some sufficiently long period, 
the relative achievement of all groups would be measured by a 
series , of' conimon tests, based on full English without regard 
to the various elementary methods. 

Data of this sort have not bei^n accessible to us for a 
numbers of reasons.. For .(xie, as we nave seen in the preceding 

chapters, the ;inumber of language students diminishes in more 

, 1 , ■ ■ 

than ^6011116 trie proportion to the timne of study involved* Our 
difficiilty in securing continuous data of this kind was 
increased by the war, for nnatiy of the programs with the 

■ii' 

,1 

14The Inveit igat ion hfidl nccoss to only one comperetive experiment of thia 
kind* The detailed eYaluation of it (H. B, Dunkel* **The Basic English 
Experiment in the Evening Elementary Schools of New York City") can be 
obtained from the Investigation. 
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largest numlber of continuing students in English were situated 
in foreign ^countries and were thus made inaccessible or were 
interrupted by hostilities. 

A much more important fact, however, is that there has been 
relatively little interest in the higher levels of English. 
While many workers have developed systems of elementary 
English, few of them have worried about what happens to the 
student after that. A number of causes probably combine to 
produce what seems to us this unfortunate result. The decrease 
in the number of students at the higher levels makes publica- 
tion of materials difficult . A commercial publisher prefers to 
aim at the market of millions of beginners rather than the 
much smaller one of those who stick with the language. Mending 
broken English and working at second-hand with other people’s 
products is never too interesting professionally. Unless a 
teacher is in a situation where he can start with a group of 
beginners and carry them all the way through, he is unlikely 
to find the work at upper levels very interesting. He will 
find that the diversity of prior training and the bad habits 
and wrong ideas (in his opinion, at least) which the students 
have acquired earlier make any organized planning difficult. 
It is much easier and more rewarding to start with a clean 
slate of beginners. 

A further cause, which we would particularly emphasize 
here* is a tendency on the part of the profession to minimize 
the magnitude of the problem which exists at the upper level. 
The assertion is frequently made that once the student has 
laid a solid linguistic foundation, he will have no difficulty 
in mastering the rest of the language. The proverb says that 
"well begun is half done," but even it does not claim that 
the whole task is completed. We have seen no evidence .that 
greater optimism is justified in linguistics. On the contrary. 
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both practical experience and theoretical considerations 
indicate the immense difficulty of this step from the elemen- 
tary to the advanced levels. 

At the elementary stages, as the similarities of the 
various systems show, the choice of materials to be covered 
is fairly easy. As regards vocabulary, for example, a certain 
limited number of words, roughly two thousand, are going to 
turn up whatever the student reads; and the application of 
criteria of selection other than frequency of occurrence also 
results in clear choices for the vocabulary of elementary 
work. As was pointed out in Chapter M, this limited "mas- 
tery" is worth little in itself. He must add to this knowledge 
if it is to be much good to him. Let us then examine the 
problem he faces in making these additions. 

To continue speaking purely in terms of vocabulary, there 
is too much of a tendency to label everything beyond the 
elementary stages as "technical vocabulary.” Presumably the 
student will pick up the jargon of his field or will already 
be familiar with it when he comes. Thus the assumption is 
that, provided he has a basic vocabulary of a few, thousand 
words and a knowledge of the special terms of his field of 
interest, he will have all that he needs. 

The unsoundness of this assumption can easily be demon- 
strated by a specific example; and since we are all interested 
in languages, the illustration can be taken from a well- 
known book on linguistics. A hasty tabulation of page 1 of 
Bloomfield’s Language on the basis of the Thorndike-Lorge 
Word Book^'® gives the following analysis of relative fre- 
quencies of the words on that page: 



ISBecauae of greatar eaaa with which roeahuiary can be examined and be- 
cftuite more work hee, consequent ly» been done with itg we state the issue 
here in terms of rocabularye The problems and principles are the same in 
regard to morphology and syntax; and the discussion should be understood as 
applying equally to them. 



^^Thorndikeg E. L. and Lorge, I., The Teaeher^e Word Book'of 30,000 
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Thorndike~Lorge Frequency by 

Ratings Thousands 

1st thousand 
2nd thousand 
3rd thousand 
4th thousand 
5th thousand 
6th thousand 
7th thousand 
8th-10th thousands 
Beyond first ten 
thousand most frequent 
words 

Anyone who has ever worked with one of these frequency lists 
knows how their findings must be interpreted with caution. 
None the less, they represent some of the most exact data we 
have; and the point at issue is still clear even if we 
interpret the table most cautiously. 

The average foreign student coming to this country ap- 
parently does not have a vocabulary of nuch over 2,000 words. 
But to allow for sampling-errors in the list, words known 
through cognates, and those derivable from better known 
members of the same word -families, we can take as a critical 
point in the preceding table the 5,000 most frequent words, 
and we will assume that the student knows all these. &it the 
table demonstrates that even a student with this large a 
vocabulary will find that many (26) words on the first page of 
Bloomfield are unknown to him. 

Are all those "technical" words which the student of 
linguistics will pick up in his reading, or are they words 
which he will encounter only in linguistic materials and 
which he cannot be expected to know unless he is a specialist 



AA 

A 

49-30 

29-19 

18-14 

13-10 

9-8 

7-4 

3- 



Occurrences on Page i 
of Bloomfield 

248 

27 

17 

7 

6 

6 

5 

10 

5 



forcfc. (New York: Coluabie UniTcreity Prose, 1946). The conrersion of the 
ratings into frequency* loTtla by thousands is that suggested in the Iford 
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in linguistics? Some of them can be so classed: e.g. , lin- 
guistic itself (Thorndike-Lorge rating » 1), predicate 
(1), dictionary (9). But what shall we say of rigid (11), 
convent ional(ly) . {9) , reasoning (13), masquerades (5), 
sophisticated (4), medieval (9), and comprehensive (7)7 
Certainly they are not technical words of linguistics or 
anything else. They are part of the common stock of any 
educated English writer. 

Since it may be argued that the first page of any book is 
not typical, a second random choice was made, page 101. This 
falls in the midst of the discussion of the phoneme, and 
scarcely any other topic is more typical of the school of 
linguistics identified with Bloomfield. The analysis of page 
101 must be on a slightly different basis because of the 
technical material: 



countries) were also omitted. Both these classes of words are 
those which the foreign student of linguistics is likely to 



Thorndike-Lorge Frequency by 


Occurrences on Page 101 \ 


Ratings 


Thousands 


of Bloomfield | 


AA 


1st thousand 


232 1 


A 


2nd thousand 


33 


49-30 


3rd thousand 


7 


29-19 


4th thousand 


0 1 


13-14 


5th thousand 


4 1 


13-10 


6th thousand 


4 1 


9-8 


7th thousand 


4 1 


7-4 


8th-10th thousands 


4 i 


3- 


Beyond 10,000 most 
frequent 


7 i 

■J 

\ 




Proper names 


22 I 




Technical 


45 I 

i 


In the preceding table, no attempt was made to classify in 
terms of freq>iency either the forty-five obviously technical | 


terms lijce 


spirant, unvoiced, lateral 


, stop, and nasal. The | 


proper nouns (names of languages, 


language groups, and 
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knctw or to add quickly to his vocabulary. Such is not the 
case with the other words at the end of the list (again with 
the Thorndike -Lorge ratings in parentheses following them) 
such as: shin (5)» protrude (4), eddying (8), variant ( 1 ), 
customary (12), preceding (9), trill (3), friction (9), and a 
number of othe.rs. Hiis selecticm illustrates the point as well 
as the other. In addition to his vocabulary of basic words 
and technical terms, the student will need a sizable vocab- 
ulary of words which are neither "elementary" nor yet "tech- 
nical." 

We are, of course, merely using Bloomfield's own words as 
an illustration of the point he himself explicitly makes: 

The myths shout peasants, workingmen, or savages who use only a 
few thousand words have no foundation in fact; in so far as one can 
count words (ignoring, for instance, the inflected forms of a 
language like ours), every adult speaker uses at least somewhere 
around 20,000 to 30,000 words; if ht i$ educated-- that it, if he 
knout techincal and learned wordt-- he utet many more. ^7 

Yet it is with educated speakers that the foreign student will 
be in contact. If he has "mastered" English only at the 
elementary level — i.e., if he has a vocabulary of only 
S'OOO words or fewer and has a similarly restricted knowledge 
of morphology, syntax, and idiom — he will find himself, in 
terms of vocabulary, for example, at least 15,000 words short! 
And as may be seen from Bloomfield's statement, this estimate 
probably errs on the side of modesty. Ihe student (and those 
who claim to help him) must, therefore, find some way of 
getting into his vocabulary these additional words which the 

^^Language, p> 277 (the itelica ere oure. ) In view of the generally 
accepted belief that in writing one uaea a larger and more varied vocabulary 
than in apeaking, it is worth noting that Bloomfield refera to the "apeaker, 

For an account of paat atudiea and further evidence, see R. H. Seaahore 
and L. 0. Eekerson, "The Meaaurement of Individual Oifferencea in General 
Engliah Vocabulariea, " Journal of Educational Psychology XXXI (1940) 14-38. 
See alao G. W. Hartmann, "Further Evidence on the Unexpected Large Sign of 
Recognition Vocabulariea Among College Studenta, " ibid., XXXVII (1946 ) 436*9. 
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educated native speaker and writer will use. Dictionaries will 
be of limited help in reading, but even the most prolonged 
practice in thumbing them will not enable him to keep up with 
the speech of an American friend or lecturer. 

Yet these words are exactly the ones which the student has 
the most difficulty in learning, simply because they appear 
with such relative infrequency. Of course one may hope that he 
will pick them up eventually. This is true of all his English; 
he could have, from the outset, stumbled around for himself. 
The educational question is whether there is some way which 
will help him do it more efficiently. And work at this leyel 
is much harder for both teacher and student. 

Sometimes classified word lists have been suggested to 
overcome this difficulty; i.e., a lesson on "Parts of the 
Body" gives ankle, shin, collarbone , and the rest. If these 
masses of words are sufficiently drilled at the time and 
adequately reviewed later (conditions usually not met), this 
method works. Another way of providing original exposure to 
the words or giving the needed review (so that the masses are 
not merely learned once and then forgotten) would be readings 
designed to give abnormally high concentrations of these 
rarer words. Instead of "grading materials down" to the 
vocabulary of the 2,000 most frequent words, the aim would 
be to "write them up" to the level of the 5,000 - 10,000 
range as far as possible<» though a heavy loading of the conunon 
structural words would naturally be inevitable. Qhly by such 
artificial concentration can the student be brought into 
contact with these less common words often enough to retain 
them. The result might sound like a bad parody of the high- 
flown style; but, like the passages "written down," the 
purpose of these readings would be pedagogical and not lit- 
erary. In elementary materials, repetition has been constantly 

good Bolection of the type of word involved in thie edvanced vocab« 
ulary can be found in Pankey and Sacha t Five Thousand Useful fords, (Naah«> 
ville: Southweatern Co»o 
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en^asized; yet the basic words are those which, by the nature 
of language, are most likely to be repeated. We clearly need 
even greater effort devoted to the less common and less 
fundamental words which require it still more. 

Before leaving this point, we should repeat the warning 
given earlier. This discussion has been in terms of vocab" 
ulary “■ and vocabulary for reading. This is not the whole of 
language. We have used it for the example only because the 
basic data (tine frequency counts of written materials) were 
g^y^^Iuhle and easily usable. But an analysis of vocabulary 
for aural comprehension or oral command would necessarily 
show the same situation, and syntax and idiom are equally 
important. There has been a striking neglect of this higher 
level of English. 

In sum, the two urgent needs of instruction in English as 
a foreign language for foreign students studying in the 
country are: fa) a raising of the general standard required 
and (b) the preparatipn of materials which will enable 
students to cover this higher level of language more ade- 
quately and efficiently and thus to meet this higher stan- 
dard. We believe that the English examinations prepared by the 
College Entrance Examination Board and to be administered 
before the student comes to this country are definitely a step 
in the right direction. If American institutions demand a 
sufficiently high level of performance on these examinations, 
further training in English here . can then deal with the 
advanced level where much help is needed. 



Know of only on* Ibook (Kelly, in Advanced Englith Courte for Foreign 
Studente) which atteapts tr grapple with these prohleaa; hnt.it ia not 
adapted to Aaerican nae and haa certain grave defects. 
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UNIVERSITY OF CHICAGO LANGUAGE INVESTIGATION 
TESTS FOR ENGLISH AS A FOREIGN LANGUAGE 

CD 

Reliabilities^ and Intercorrelatims 





Reading 


Aural 


Reading 


.90 


N=102 


Aural 


.75 


.81 


Structure 


.70 


.66 


Writing 


.58 


.57 


Elementary 


.6p 


.39 



St rue tm re 



Structure 


Writing 


Elementary 

Structure' 


N=156 


N=i55 


N=100 


N=107 


N=107 


N= 28 


1^ 


N=190 


N= 56 


.7(P 


uu 


N= 49 


.74 


.77® 


L2li 



)ysplit«half corrected by Speermen-Brown, The reliebilit iea were baaed 
on the following Reading 292, Anral 155, Structure 339, Elementary 

Structure 161. 

®The correlation ration are »b2 and *77, the latter of which (reading on 
structure) ia significantly greater than r at the IX level. 

®The correlat ion ratios are *73 and .86, the latter of which (structure 
on writing) is significantly greater than r at the IX level. 

®The correlation ratios both round to .87 and are significantly greater 
than r at the IX level. 

®Bec ause few students who took Elementary Structure also took any of the 
advanced testa, all correlations with this test are baaed on small iVa. 



Chapter VIII 

A Slatemeiit of Coiielusioiis 
and Further Needs 



Ihe preceding chapters have given detailed descriptions of 
our procedures and of the various prograims with which we 
worked. The varied aims, methodologies, situations, and re- 
sults which characterize these individual language courses - 
particularly the experimental undertakings described in 
Chapter VI — make generalization hazardous. Yet the single 
trees, considered collectively, do form a forest; and language 
teachers are probably more interested in a general picture 
than they are in the nature and success of any specific 
experiment. 

The controversies about the newer programs^ produced 
heated debate on such topics as the actual achievement of the 
experimental courses, the superiority (if any) of their results 
oyer those obtained by more conventional approaches, the ef- 
ficacy of certain features of them (intensive drill, initial 
aiiral-oral emphasis), and the like. Whatever may be the short- 
comings of our evidence (and we have gone '^%0 considerable 
pains in the preceding pages to indicate these weaknesses as 
clearly as possible), our data constitute at present the most 
exten.3ive and objective answers to some of these questions. 

^The stateaents pro and con about these and other issues (which date froa 
the period of the ASTP) are fully recorded ia P. F. An«iolillo, Armed 
Forces* Foreign Language Tiachin^ (New York: F. S. Vanni, 1947). 
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In addition to juidginents about the present state of 
affairs, however, we feel some responsibility for stating 
what appear to us to be the most pressing needs of language 
study in the near future. Obviously our hypotheses about 
these matters are not proved by the data but are only 
suggested by them and by our experience in observing and 
testing a fairly wide variety of language courses. 

Even the conclusions must be more tentative than would be 
desirable. In Chapter I we pointed out that an investigation 
should develop certain hypotheses which can then be tested in 
controlled situations until they merit the name of demon- 
strated conclusions. As we also pointed out in Chapter I, 
existing circunstances did not permit this procedure. None the 
less, we have used all possible caution and believe that the 
following summaries and conclusions constitute the soundest 
judgments which can be made at the present time. 

DESCRIPTION OF THE EXPERIMENTAL COURSES 
Objectives 

All the programs had essentially the same set of objec- 
tives: ability to speak, to understand, and to read the 
foreign language. The initial goal was the development of 
oral and aural skills, and the ultimate goal was the attain- 
ment of reading proficiency. Functional grammar, intended to' 
contribute to both oral-aural and reading competence, was em- 
phasized in all phases of many courses, but in few if any pro- 
grams was the active manipulation of structural patterns an 
end in itself. Translation from English into the f«.)reign 
language according to grammatical rule was generally not 
practiced. There was virtually no insistence on ability to 
write the foreign language. 

Rationale 

The basic assumption on which the programs rested was that 
a second language, like a first (i.e., native) language, is 
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most naturally acquired in its spoken form and that a solid 
and lasting ability to read a language best results from 
previous acquisition of that speech which its written form 
symbolizes. Thus the ear and tongue are to be trained first, 
and the eye only later.. This became the justification of 
teaching comnand of the spoken language even where, within 
the liberal *"arts tradition, the cultural reading aim could 
and must not be forsaken. This distinguished the program, in 
the last analysis, from' a "Berlitz- type" course. 

A complementary and also partly justificatory assumption 
was that in the world of today, struggling as it is toward a 
single peaceful society, a nation must avoid linguistic isola- 
tion by training more of its citizens to use the languages of 
other nations, and so equipping them to take an intelligent 
part in international affairs. 

■'■A third assumption was that most American students are 
more highly motivated to elect foreign -language study and to 
persevere in it, if the reward of their choice and their 
effort is to be proficiency in using the language in its 
spoken form, than if their only accomplishment is to be 
reading ability. 

Given these three assumptions on which recourse to an 
initial oral-aural approach was based, we may proceed to 
examine the principles of oral-aural instruction as followed 
in the experimental programs. 

The cardinal principle' was that the acquisition of oral 
and aural ability, in a second as in the first language, is 
primarily a mechanical rather than an: intellectual process, 
Comparable to a skill in art or craft and not to a mental 
discipline. Its first requisiite is practice - practice in 
hearing and imitating speech utterances, and quickly associ- 
ating them with their meaning while doing so. This practice 
consists of simple 'mimicry-memorization at first, during the 
formative period of the sound -producing habits; later it 
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consists in increasingly varying the basic patterns by 
smibstitwting different forms or different words for one or 
more of those contained in the original utterance, and by 
answering questions; eventually the already acquired patterns 
are used and varied in real or simulated conversation. The 
more hearing, imitating, repeating, memorizing and eventual 
varying of the utterances the better, until the point' is 
reached where they are over” learned. Ideally such practice 
should go on continually; and in conformity with this prin- 
ciple, experimental oral-aural courses required the maximum 
possible amount of the student’s time in which the practice 
could be directed end supervised by native speakers of the 
language. Furthermore, each student must be provided with 
opportunity for individual practice. Choral practice is 
valuable up to a point, for straight listening and mimicking, 
but pattern-variations and actual conversational interchange 
must be on an individual basis; consequently * in oral-aural 
experiments the number of students participating in class- 
room practice was held to the absolute minimum possible. 

While requirement number one was practice, which is 
mechanical, a second essential of the oral -aural approach 
was analysis, which is intellectual. The adult learning to 
use a second language differs from a -child learning his 
native tongue in that he can, theoretically at least, bring 
his intellect to bear on his problem and can speed up his 
learning process immeasurably through generalizations, short- 
cuts and insights into the way the language operates, if and 
when he understands its structure analytically. In accordance 
with this principle experimental, courses provided, along with 
practice, instruction in the phonology, morphology, and syntax 
of the language. In this connection, a second principle 
applied in some programs was that, in .order to be meaningful, 
grammatical interpretation and analysis must be made strictly 
in terms of patterns already familiar to the learners through 
the mimicry-memorization process. 
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Organization 

In conformity with these complementary principles of 
mechanical and analytical learning, two kinds of instructional 
situation were provided: (1) "lectures" or "demonstrations" 
by the linguist in charge, before the entire student group 
(or before sections of fifty or sixty students if the en- 
rollment was large), and (2) "drill" or "practice" sessions, 
limited to ten or twelve students each and conducted by 
native speakers of the language. 

The number of contact hours per week, embracing both 
lectures and drill sessions, varied between six and fifteen, 
the commonest being eight. Generally, two different inter- 
pretations prevailed with respect to the equating of these 
contact hours with semester hours or credits. Some programs 
v^ere designed to bring the students to two-year levels of 
proficiency in one year; in these the amount of credit 
traditionally given for regular language courses was doubled, 
and the students were expected to devote additional time to 
home study of the language over and above their weekly class 
hours. Other programs, while roughly doubling the weekly 
contact time of conventional courses, still aimed to cover but 
a single year’s work in a year and regarded the increased 
classroom practice as a partial or total substitute for 
outside study; in such courses credit hours remained the same 
as for conventional courses. 



Staff 

In general, the teaching staff of an experimental program 
consisted of a course director, who was a regular member of 
the foreign- language department of the institution, and of 
instructors variously designated as "drill masters," "guides," 
"informants," or the like. The course director gave the 
lectures, and planned and supervised the work of the instruc- 
tors; the latter conducted the drill sessions. 
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The inatructors were for the most part native speakers of 
the language in question, but their background and experience 
as foreign- language pedagogues varied considerably, in some 
cases even within a single program. In some programs it was 
held that native speech was the only requisite of a drill 
instructor, and that indeed previous experience in teaching 
a language might lead him to spend prac.tice time on gram- 
matical or other professorial digressions when he should be 
serving as a model or making the students use the language 
during every moment of the precious contact time. Where this 
attitude prevailed, drill instructors were recruited from 
any available source — from foreign students attending the 
institution to purely chance members of the community. They 
were expected to serve short terms of one or two years only. 
In other programs it was felt that the native -speaking 
instructors should also be experienced teachers who as 
persons of education and culture could impart to the students 
a first-hand acquaintance with the people and institutions 
of their native countries. In small-scale operations, native 
instructors of the latter type were generally available 
within the regular teaching personnel of the language depart- 
ment ; in the larger programs both types of native speaker — the 
untrained recruit and the experienced pedagogue who was a 
regular member of the staff — were likely to be serving side 
by side. 

Materials 

The most widely adopted series of textbooks specifically 
designed for use in oral -aural courses were the manuals of 
Spoken French, Spoken German, etc., first developed for use 
in Armed Service programs and later made available for 
civilian use.^ With the material organized according to an 
identical plan for all languages, these manuals present 

“^French, Italian, Portugeae, and Spaniah are pulbliahed Iby Heath, and the 
other languagea of the aeriea by Holt. 
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thirty chapters or "units" consisting of "basic sentences" to 
be miimiclked and memorized; "hints on pronunciation"; a secticn) 
of "word study" designed for structural analysis of the basic 
material and organized by grammatical categories; a "lis- 
tening in" section consisting of variations of the basic 
sentences, designed primarily for aural practice; a set of 
exercises calling for completions, substitutions, choices and 
the like entitled "What would you say?"; and finally sug- 
gestions for carrying on "conversation." The units are 
topical, and carry titles such as "What’s Your Trade", 
"Laying in Supplies", "Fill 'er Up", etc. Each of these 
topical units contains material for six to eight hours of 
class work, and directions are provided for individual home 
study and review. In every text the foreign- langua g e material 
does not appear in normal orthography during the first six 
units, being reproduced instead in phonetic transcriptions 
designated as "aids to listening." 

Other texts extensively used were Harris and L^vSque, Con- 
versational French (Molt); Hehder and Twaddell, Conversational 
German (Holt); La Grone, Conversational Spanish for Beginners 
(Holt); and the Dacca Language Series entitled Les Aventures de 
Robert Martin^ Las Aventuras de Roberto Martin, etc. All these 
texts are organized primarily by tc^ics of everyday experience, 
and provide basic material for mimicry-memorization together 
with grammatical analysis and practice exercises. All of them 
introduce conventional orthography from the beginning; and do 
not make use of phonetic transcriptions. 

No short list of reading texts would be representative of 
those selected for the experimental programs. Adoptions varied 
as widely as in conventional courses. 

Audio-Visual Aids 

Though there has been much talk about the value of various 
electronic sound -machines in foreign -language instruction, 
little if any use of such devices was observed even in the 
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sporadic cases where a language department owned one. Course 
directors did not seem yet to have worked out practical 
techniiquea for using wire or tape recorders, which require 
deft operation and carefully planned integration with course 
procedure if they are to prove efficient, time-saving sub- 
stitutes for, or supplements to, living models and not merely 
time-wasting curiosities. 

Here and there textual materials and supplementary exer- 
cises were locally recorded on phonograph disks and utilized 
for aural practice, and occasional recordings were made of 
students' speech. In general, however, the only audial aid 
extensively used was the ordinary phonograph. Records are 
available, for example, reproducing the basic sentences and 
aural exercises of the Heath and Holt spoken language texts, 
and in several programs these records were used by the 
linguists in charge for demonstrating the sounds of the 
language, or by the students themselves for extra practice in 
hearing and repeating the lesson material. 

ACHIEVEMENT IN THE EXPERIMENTAL PROGRAM 

The results achieved in different programs were far from 
uniform. The present over-all appraisal is a generalization 
based on the average level of achievement, and only occasion- 
ally calls attenti'>n to important and clearly explicable 
deviations from that mean. It will further be understood that 
we are talking in terms of the average student within a 
given program. On our measures the deviations from the mean 
performance are usually not great in relation to the full 
range of possible measurement ev«i in the cases of the "best" 
and the "poorest" students. In other words, even exceptional 
individuals need not be thought of as achieving perfection 
on the one hand, or zero on the other. 

Oral Production 

For the reasons given in Chapter IV (pp. 97-98), we failed 
to secure extensive objective evidence on students* oral 
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competence, and the following appraisals are based in large 
part on our personal judgments. 

As regards pronunciation, short utterances (ten to twelve 
syllables) could be immediately imitated by most students 
almost perfectly. Enough time was never a*^ liable, however, 
for sufficient drill in this direct imitation to produce 
fundamental changes in the students’ speech habits. We believe 
that fifty to a hundred times as many repetitions as were 
actually fciasible would have been required to inculcate new 
habits of articulation and intonation. As it was, students 
tended to relapse rather quickly into the phonemic and into- 
national patterns of their native tongue. An utterance which 
had originally been imitated very accurately often reappeared 
later with a partial or complete substitution of English 
phonemes. This tendency to revert to native sounds increased 
sharply when the utterance was long or otherwise difficult, 
and the sight of writing (even a phonetic transcription) had 
the same effect. Another factor which apparently retarded or 
even halted some students’ development in pronunciation was 
the urge to avoid conspicuous excellence. 

In many programs, lectures given early in the course 
dealt with phmietic problems and described the phonology of 
the foreign language, on the theory that students can improve 
their speech through conscious understanding of the physiology 
of sound production as well as through direct imitation. 
Clearly the actual contribution of phonetic analysis to 
speech improvement can be measured only under more controlled 
conditions than we encountered in any program. One need only 
observe an average group studying descriptive phonetics to 
conclude that, while some students do seem to benefit from 
it, to many students it means less than nothing. 

Nevertheless, despite the failure of most students to re- 
tain the excellent pronunciation observable in immediate 
im.itatiun, the majority were observed to have a continuing 
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production suporior to thftt of conventions! students who 
were taught to speak by rules of "how the letters are pro- 
nounced," and who have never heard a native speaker. Also, 
students entering an oral-aural course after previous study 
of the language, in high schools where English habits were 
tolerated, generally never succeeded in matching the pro- 
nunciation of those who were taught from the beginning to 
imitate native models. 

We saw few exhibitions of what could honestly be called 
spontaneously fluent speech. While many students could 
participate in memorized conversations speedily and effort- 
lessly, hardly any could produce at length fluent variations 
from the basic material, and none could talk on unrehearsed 
topics without constant and painful hesitation. The main 
contributing factors seem to have been slow vocabulary recall 
and difficulty in manipulating gramnatical forms. 

The range of vocabulary and idiom was strictly delimited 
by the topics and situations treated in the conversational 
textbooks studied. As noted above (see p. 33), most such text- 
books are heavily loaded with specific environmental terms, 
and 'in compensation omit many common words necessary to a 
minimum adequate vocabulary. Even within the range set by the 
textbook, automatic recall of any but the most frequent words 
was rare. After reading had been introduced into a course, 
new words and expressions met with in this connection were 
generally slow to find their way into the students' active 
vocabulary. 

Regardless of the students' miderstanding of the structure 
of the basic material which they mimicked and memorized (i.e,, 
their passive grammatical knowledge), they had little ability 
to manipulate forms and constructions actively in their 
attempts at Variations or at free speech. Knowledge of 
linguistic structure enables one to "work out" a desired 
pattern if given enough leisure, but the structure itself is 
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so complex that it cannot be manipulated consciously in 
speech production without endless practice in minimal varia- 
tions of form and construct — and in no program was time 
available for quantities of such drill. 

Aural Comprehension 

Generally speaking, students* aural comprehension as ob- 
served in class work was better than their oral production. 
Most of them learned adequately to comprehend the basic 
material of their conversational textbooks as spoken normally 
by their instructors, as well as variations of that material 
designed for aural practice. They were not, however, quick to 
understand casual or unexpected utterances for which they 
were not prepared. Furthermore, their comprehension was of 
course subject to the limitations of the relatively narrow 
and specific vocabulary of their lesson materials. 

The objective data on aural comprehension yielded by our 
testing program have been extensively analyzed and inter- 
preted in foregoing chapters, so that the briefest statement 
of findings will suffice at this point. By and large, experi- 
mental students failed to understand the phonographically 
recorded utterances of an unfamiliar native speaker, delivering 
unfamiliar though easy material, significantly better than 
did conventional students. It is true that the causes of this 
similarity of performance were seemingly different for the 
two types of course. While conventional students lacked aural 
ability because they had not been taught it, experimental 
students failed of higher attainment in part because the 
limits of their comprehension experience (particularly in 
terms of known vocabulary) were those of their textual mate- 
rials and were much narrower than those within which the tests 
were designed to measure aural competence. With due allow- 
ances made also for the shortcomings of the tests, the fact 
remains that most experimental students did not give evidence 
of approaching native aural ability. 
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Reading and Vocabulary 

We have no objective data on the levels of reading profi= 
ciency eventually reached by students who progressed from 
experimental courses into advanced reading or literature 
courses. Within the short period of our project, too few 
students continued into advanced work at the same school. Our 
testing program covered experimental groups at the end of one 
and two (rarely three) years, and provided comparisons of 
reading achievement with conventional groups at those same 
stages. In general, as shown in the analysis of test data in 
Chapter VI, the experimental groups did not demonstrate so 
high a level of reading proficiency at the end of their first 
or second year as did conventional students. In a number of 
cases the results were significantly poorer. There appear to 
have been two chief reasons for this outcome: (1) in many 
programs so much time was devoted to the initial oral-aural 
objective that much less reading was done than in conven- 
tional courses; (2) as some programs were organized, the 
responsibility for teaching reading devolved upon drill 
instructors who were unequipped to deal with the very dif- 
ferent problems of developing reading ability. These instruc- 
tors had little knowledge of what particular constructions 
constitute hazards for the English-speaking student, or what 
vocabulary items should be emphasized as worthy of inclusion 
within his active or passive range of control. 

In the vocabulary parts of the reading tests, the experi- 
mental students knew fewer words than conventional groups. The 
reasons were presumably the same as in the case of reading 
and the specific Vocabulary items learned from the spoken- 
language textbooks did not coincide to an appreciable extent 
with high-frequency items used in the reading tests. 

On the grammar sections of the Co-operative tests, experi- 
mental students generally tended to be as successful as con- 
ventional groups. As contrasted with their comparative failure 
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in reading and vocabulary, their grammatical proficiency 
seems attributable to the early and continuous study of 
structure in connection with their oral-aural materials, 
under course directors who were in substantially all cases 
experienced teachers of linguistic analysis. 

VINDICATION OF ASSUMPTIONS 



The followirg two assumptions underlay the experimental 
courses: (1) that oral -aural proficiency is the best gateway 
to reading ability; (2) that students are highly motivated to 
study a language via the oral -aural approach. 

1. As far as we were able to follow the experimental groups, 
i.e.f mainly through the first and second years of study, the 
evidence from the tests indicates that superior reading skills 
were developed in those programs where reading received the 
greatest time and emphasis. The highest levels were reached in 
reading-method courses which featured moderate ainounts of 
classroom oral-aural practice directly related to the material 
read. On the other hand, experimental students whose oral- 
aural coimmand was limited to the scope of their spoken- 
language textbooks were observed to be unable either to 
understand reading material presented to them viva voce, or to 
discuss in the language the content of their readings. 

As to the assumption made in some quarters that oral -aural 
competence automatically creates reading ability and that 
consequently the latter need not be specifically taught, there 
is evidence per contra so far as the experiments observed are 
concerned. It may well be that a hypothetical student who has 
acquired near-native oral-aural competence (including the 
possession of, say, a twenty- thousand -word active vocabulary) 

would find himself able to read the language excellently 
without Specific training in that direction. However, this 
hypothesis is hardly applicable to the students observed in 
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experimental courses, lliere, only those who were carefully 
and expertly taught reading skill as an attainment distinct 
from that kind of oral-aural competence which proved to be 
teachable within the scope of the program, were able to 
demonstrate notable success in reading. Finally, low corre- 
lations of reading and aural test results from bjth experi- 
mental and conventional programs furnish conclusive evidence 
that (a,t least as sub-native levels of competence) oral-aural 
and reading proficiency constitute separate, independent 
skills which do not develop one from the other but rather only 
from direct training in each separately. 

2. With few exceptions language students claim to be more 
highly motivated by oral-aural than by grammar and reading 
goals. Many elect the experimental courses eagerly with the 
purpose of getting a speaking knowledge. As the course begins 
they are pleased to find themselves able to say and understand 
the simple phrases of Lesson One. By Lesson Five they arc 
convinced that if they went to the foreign country they could 
"get by." But as drill -sessions succeed each other with re- 
lentless regularity, and as the material becomes more and more 
difficult to assimilate, many begin to tire or to lose 
interest and fail to apply themselves to the extent the method 
demands in order to assure continuing success. Ulieir home 
study, in aliich the necessary over-learning could be^ achieved, 
is neglected, memorization does not keep pace with mimicry, 
the tempo of drill sessions is slowed, and boredom sets in. In 
short, w^ile the average student professes continuing enthusi-r 
asm for the goals. .and the method, in reality his dwindling ap- 
plication is a factor which operates in preventing average 
outcomes from- reaching higher levels. 

ADHERENCE TO PRINCIPLES 

To what extent, in actual practice, did the experimental 
programs adhere to the principles on which they were based? 
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llie prevailing number of contact hours per week, although it 
was invariably the maximum possible within the total course 
of study at a given institution, did not provide enough time 
for that, repeated drill with the same material which alone 
results in the necessary over-learning, or for the protracted 
practice with pattern variations which^ alone leads to flex- 
ibility and ultimately to fluency. Furthermore it was not 
possible to require sufficient amounts of laboratory or home 
' study, involving unsupervised drill with records or the like, 
to cmnpensate for the shortage of classroom practice. 

The number of students participating in drill sessions was 
often not rigidly controlled, especially in large programs 
where even, with numerous drill-sessions scheduled at different 
hours of the day, the inevitable conflicts in students* 
individual course schedules frequently necessitated the un- 
balancing of dr ill- sections; a consequence, of course, was 
that some students received less individual attention and 
practice than others. 

In the grammatical analysis phase, the principle of 
keying the lectures to the drill was frequently interfered 
with by ^schedules which had students who attended the same 
lectures drilling a given set of material at different times, 
some before the lecture and others after it. 

There were very few exceptions to the practice of enploying 
native speakers for drill instructors, and those who did not 

so qualify were nearly bilingual or had entirely authentic 
pronunciation. 

FURTHER NEEDS' 

The^ experimental courses evaluated, by the Investigation 
generally failed to produce near^native oral-aural or reading 
proficiency in the American student of a second language in one 
or two years. In other words, within the total instructional 
time available for these experiments, the newer procedures 
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and teclmiques have not proved themselves impressively 
in training students of average aptitude and motivation. 
Perhaps the goal was unrealistically high, but it was that 
sought by many experimenters; and only a near-native ability 
will justify some of the advantages claimed for the skills. 
In any event, it is quite improbable that within the normal 
high -school or college curriculum still more time can be 
obtained than has been available to current experiments. 
Therefore, if the newer programs are ultimately to vindicate 
the assumptions which underlie them, improvements in procedure 
and technique must be brought about within the organiza- 
tional framework (including the time allowance) already 
acquired. It seems to us that such improvements can and will 
be effected through careful attention to a number of needs 
which suggest themselves rather clearly. 

The Need For More Precise Definitions 

Despite eager discussion and experimentation in the fields 
of aural comprehension and oral production, language teachers 
are still working their way toward generally accepted defini- 
tions of these abilities. SinOe the level of native competence 
will obviously not be reached soon, some explicit standard 
short of that must be set up, at least temporarily. Thus far 
there has developed little general agreement about such 
obvious matters as the kind of topic which the student is 
expected to be able to handle orally and aurally, the total 
number and range of these topics, the nature and extent of the 
vocabulary needed, and similar points. The textbooks con- 
stitute one approach to evolving this canon for the aural and 
oral skills; but, as we have seen, they still reflect pri- 
marily the personal and somewhat random choice of their 
respective authors and not a clear body of theory. Standard- 
ized tests represent another approach to the problem. In any 
event, whatever materials help to clarify the issues, the 



A STATEMENT OF CONCLUSIONS AND FURTHER NEEDS 



295 



profession needs to develop a more explicit and justifiable 
consensus on all these matters. Only then can the verbal 
symbols like "oral command" be meaningful in our discussions, 
and only then can tests be constructed which will accurately 
measure the skills precisely as they have been defined and 
thus demonstrate the students* achievements .unequivocally. 

The Need to Re-examine the Language Requirement 

It is not within our province here to urge the extension, 
retention, or abolition of the language requirement. The 
present evidence does lead us to suggest, however, that 
language teachers might well re-examine the desirability of 
the requirement in view of the high level of linguistic pro- 
ficiency they hope to innpart to students. Hie language skills 
apart from their concomitant values are rewarding only after 
they have been attained to a considerable degree. Certainly 
the uses and values commonly claimed for second- language study 
presuppose a fairly hi^ degree of mastery. The question is, 
then, whether language teachers can hope to give this amount 
of skill to the masses of students (many of them possessing 
slight ability and still less motivation) brought into 
elementary and intermediate classes by the language require- 
ment. Their presence acts as a brake on the progress of the 
more promising students. Special sectioning, while it has 
proved impossible in most small experimental programs, may 
ultimately avoid this difficulty. But there still remains the 
problem of bringing this less likely raw material up to the 
required standard. Though we have spoken specifically of the 
achievement of only the upper half and upper fifth of the 
conventional groups we studied, the reader can find in the 
complete norm tables the present status of the lower half or 
similar groups. These students languish in the limbo of those 
who cannot read nor speak nor comprehend. For the profession 
to contract to deliver linguistic skill to these students is a 
responsibility not to be lightly undertaken. 
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The Need for Greater Modesty of Claims 

Teachers of all second languages will ultimately benefit 
from greater restraint in claiming what they can accomplish 
and from a candid acknowledgement of the limited skill which 
the average student will acquire within the time of the 
average course. Several champions of the cause of language 
teaching have already warned that, whatever improvements the 
new procedures may eventually make possible, they do not work 
miracles; but the natural flush of enthusiasm attendant upon 
new undertakings has raised some overly sanguine hopes. Pro- 
ponents of the newer methods have made much of the disillusion- 
ment experienced by earlier generations of students who, 
after several years of foreign language work, still felt 
like deaf mutes. Yet the indignation of students who have 
been led to believe that they can achieve aural-oral ‘^mastery," 
but who later find that they lack complete competence, will be 
even more righteous and will recoil even more sharply upon 
the profession. Language learning remains a long, hard road, 
and the average student, despite possible improvements in 
teaching procedures, will probably not get very near the end 
of it. A clearer understanding of what is expected of him and 
of what, in turn, he can expect will produce a better situa- 
tion in the long run. 

The Need for Better Articulation of the Skills 

For some time many language teachers have doubted whether 
initial reading ability could later be easily expanded 
to include aural and oral commands. On the other hand, some 
proponents of the oral -aural introduction had assumed that 
these abilities would lead, almost automatically, to sst is factory 
reading ability. Many parts of our data cast grave doubt on 
this assumption. At least under present circumstances (though 
these are not necessarily immutable, as we shall note in a 
moment), the various skills must receive considerable indi- 
vidual attention. Course directors who have recognized this 
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fact, however, have confronted a whole series of problems. In 
shifting from oral -aural work to reading, they have searched, 
almost in vain, for materials which would effect the transfer 
with the minimum break in continuity. Another problem has been 
that of deciding when the transition should be made. Some 
courses using the aural -oral approach have introduced reading 
materials after the first week or two; others have contained 
no written materials other than phonemic transcriptions until 
well into the third academic quarter. Most course directors 
and many outside critics have questioned the soundness of 
whatever particular procedures were used; and many observers 
would explain some experimental programs’ lack of success 
chiefly on the grounds that the change in emphasis was not 
made in the proper way, at the proper time, or with the proper 
preparation. Both these opinions and the evidence suggest 
that the satisfactory articulation of work with the different 
skills remains a major problem yet to be solved conclusively 
by the newer courses. 

One aspect of this same problem even involves schedules. 
Most oral -aural courses have sought as intensive a program as 
was possible in ordinary academic schedules, increased 
class time met an important requisite for the acquisition of 
the oral-aural skills, the opportunity for extended practice. 
An analogous need exists in regard to reading; but for it, 
instead of additional class hours, the student needs more 
outside reading time. Most programs, however, continued their 
larger amounts of class contact and thus reduced the time 
available for reading practice even after that skill had been 
taken up. This difficulty admirably illustrates the queer 
guises under which the problems of articulation appear. 

Thus far we have discussed the problem of articulation as 
it now exists. The greatest need, however, is to reduce its 
present size. As we have seen, existing materials, vocabu- 
laries, and nearly everything else connected with speaking and 
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listening differ drastically from those used in connection 
with reading; and it is this difference, of course, which 
produces the problem. In our opinion, the gap could be con- 
siderably narrowed by attempting to bridge it from both sides. 
New reading texts embodying fictional aiKl (especially) non- 
fictional material could utilize subjects, styles, and vocabu- 
laries much closer to those usable in oral -aural work than 
they now do. Materials giving cultural information about a 
linguistic area, for example, might well be prepared in this 
fashion. On the other hand oral-aural materials now represent 
a rather arbitrary selection of vocabulary and content. In 
their effort to give the specific vocabulary for certain 
selected situations, they often make some rather startling 
omissions of words which are basic to the language, whether 
written or spoken. Less emphasis on the tourist and a greatei 
realization of the wider extent of possible oral-aural 
situations can bring about greater rapprochement from this 
side too. 

The Need for Better Tests 

As we have frequently pointed out, markedly better tests 
for the aural and oral skills will be possible only after 
these abilities have been defined more exactly. When this 
clarification has been achieved, then tests for general use 
can be constructed which will measure validly the elements of 
the skills as thus defined. Meantime, better and greater use 
can be made of existing instruments. Without some sort of 
objective standard, wishful thinking and other influences will 
continue to affect estimates of achievement. 

The Need for Qualified Drill Instructors 

If teaching staffs are to include instructors whose 
primary qualification is that they are native speakers and 
whose role does not extend beyond supervision of drill 
practice, such native instructors need thorough orientation 
as well as continuous training by their directors. They need 
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to have a precise conception of both the potentialities and 
the limitations of their function. On the one hand, they must 
be adept at handling groups of American students sympathet- 
ically and tactfully while at the same time stimulating them 
to put forth their best efforts in drill and conversation. On 
the other hand, they must regard themselves as models of their 
native spoken language aud not as philologists or graminarians; 
they must remember to teach the language, not tc teach about 
the language. And since all native speakers are not by 
definition persons of sufficient intelligence and adaptability 
to learn the role of drill instructor, methods of procurement 
must be such as to assure a ready supply of those who are 
pptentially qualified. 

If, instead of (or in addition to) the type of drill 
instructor we have just mentioned, trained teachers regularly 
on the staff are to conduct drill practice in addition to 
their other assi^ments, they too need training in the special 
technique of drilling as distinguished from the regular 
classroom teaching to which they are accustomed. 

The Need for Improved Use of Audio^’V isual Aids 
and Extra-Curricular Activities 

These seemingly dissimilar topics are united by common 
implications for the improvement of aural-oral programs; Only 
a full utilization of all possible resources seems likely to 
produce a satisfactory level of student achievement within the 
time available. While both audio-visual aids and extra- 
curricular activities now exist on most campuses, neither of 
them as yet appears to be making its maximum contribution. 

The great difficulty with audio-visual aids is that they 
have usually not been adequately integrated with the work of 
the course. Audial aids in the classroom can relieve the 
drill instructors of the more mechanical aspects of their 
work and thus free them for more personalized attention to 
individual students. Outside the classroom, these aids will 
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have even greater value, provided they can be constantly and 
easily made accessible to students for additional practice. 
Improved use of audio-visual aids will probably depend on a 
number of factors: improved equipment, greater variety and 
better quality of materials, and greater experience on the 
part of teachers in using these devices. Even under present 
conditions, however, they are a potential ally whose services 
are largely neglected. 

Language clubs, language houses, and language tables are 
treated by many staffs in a rather perfunctory manner or 
regarded as an unpleasant duty. They offer, however, a 
further opportunity for that practice which is so important 
in the acquisition of the aural-oral skills and especially in 
understanding and using variations on those basic patterns 
which students have mastered in class. Enterprising students 
can be counted on to organize these extra-curricular activities 
if they are given the support and encouragement of the language 
staffs. When these undertakings are well organized and well 
co-ordinated with regular classroom work, they can serve as 
effective supplements to it. 

The Need for More Precisely Planned Experiments 

As we have pointed out, current experimental programs have 
left unsolved a number of basic problems of language learning. 
Since language is an intricate mechanism which operates in 
nearly all human thinking and doing, the principles of 
language teaching and learning become highly complicated. The 
second volume of this report, in examining what we now know, 
will reveal some major areas of ignorance. There is still a 
serious need for experiments designed to test one by one in 
carefully controlled situations these fundamental problems 
which confront the language teacher in his search for perfec- 
tion. Because of the wide range of factors which must be 
taken into account, language experimentation is extremely 
difficult and demands the most careful planning and execution. 
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Unfortunately, in practice most experiments are hastily con- 
ceived, short-lived, and executed under appalling difficulties. 
Certainly the profession cannot effect^-major improvements in 
many of these respects overifight . None the less, greater 
effort must be made in that direction if results even remotely 
approaching conclusiveness are to be obtained. The data and 
suggestions offered in the second volume are intended to 
help along these lines. 

The millennium in language teaching has not yet arrived; 
but in this field, as everywhere else, men of good will can 
only continue and redouble their efforts to bring it about. 



304 



AN INVESTIGATION OF SECOND-LANGUAGE TEACHING 



I: 



FRENCH AURAL COMPREHENSION NORMS 
LOWER LEVEL FORM A 



DECILES l*T.I PT.EPT.m TOTAL 
(25) (SO) (41) (95) 

Group OA 

(28 students in 2 schools) 



DECILES PT.I 
( 25 ) 



PT.H PT.m TOTAL 
(SO) (41) (if) 



Group OB 

(305 students in 8 schools) 



9 


9 


13 


16 


35 


9 


7 


18 


14 


33 


8 


8 


13 


13 


27 


8 


6 


14 


11 


27 


7 


4 


10 


11 


23 


7 


5 


11 


9 


23 


6 


3 


9 


9 


19 


6 


4 


10 


7 


20 


5 


2 


.7 


5 


16 


5 


4 


9 


6 


17 


4 


1 


6 


4 


14 


4 


2 


6 


5 


15 


3 


0 


5 


3 


11 


3 


1 


6 


3 


13 


2 


0 


2 


2 


10 


2 


0 


4 


2 


10 


1 


0 


0 


1 


5 


1 


0 


2 


1 


7 


Means 


3.43 


7.43 


7.22 


17.94 


Means 


3.47 


9.15 


6.76 


19.06 


Group OC/D 

(98 students in 5 schools) 


Group lA 

(44 students in 3 colleges) 


9 


8 


19 


18 


39 


9 


9 


14 


17 


33 


8 


7 


17 


15 


33 


8 


8 


12 


15 


28 


7 


6 


14 


13 


30 


7 


6 


10 


11 


25 


6 


6 


13 


11 


28 


6 


4 


10 


9 


23 


5 


4 


11 


9 


26 


5 


4 


9 


8 


21 


4 


2 


10 


7 


23 


4 


3 


7 


7 


18 


3 


2 


9 


6 


19 


3 


2 


6 


5 


16 


2 


1 


7 


5 


15 


2 


1 


3 


2 


13 


1 


0 


4 


1 


11 


1 


0 


1 


1 


10 


Means 


4.04 


11.52 


9.82 


25.06 


Means 


4.77 


8.39 


8.82 


21.86 


Group IB 

(1808 students in 21 colleges) 


Group 2 
(196 students in 


11 colleges) 


9 


10 


19 


19 


42 


9 


13 


22 


25 


58 


8 


7 


17 


16 


36 


8 


11 


21 


21 


47 


7 


6 


14 


13 


31 


7 


10 


18 


17 


40 


6 


5 


13 


11 


28 


6 


7 


17 


14 


36 


5 


4 


11 


10 


25 


5 


6 


14 


12 


32 


4 


3 


10 


8 


22 


4 


4 


12 


10 


27 


3 


2 


8 


6 


19 


3 


4 


11 


7 


24 


2 


1 


6 


4 


18 


2 


2 


9 


5 


20 


1 


0 


4 


2 


12 


1 


0 


6 


3 


14 


Means 


4.40 


11.58 


10.26 


26 • 38 


Means 


6.71 


14.29 


13.11 


33.86 



er|c 



NORMS FOR TESTS 



305 



FRENCH AURAL COMPREHENSION NORMS 
UPPER LEVEL FORM A 



DECILES 


FT. 1 


FT.n 


FT.m 


TOTAL 




(29) 


(40) 


(19) 


(80) 




Group IQD 






(72 


students in 3 


schools) 


9 


10 


23 


6 


35 


8 


8 


20 


4 


30 


7 


7 


18 


4 


27 


6 


6 


16 


3 


25 


5 


4 


14 


3 


22 


4 


2 


12 


2 


18 


3 


2 


11. 


Z 


15 


2 


1 


7 


0 


11 


1 


0 


6 


0 


9 


Means 


4.93 


14.36 


2.88 21.91 



DECJLES FT. I FT.D rT.HI TOTAL 
(29) (40) (tS) (80) 



Group lOF 

(30 students in 3 schools) 



9 


16 


25 


6 


44 


8 


13 


23 


6 


37 


7 


12 


20 


3 


33 


6 


8 


19 


3 


29 


5 


7 


17 


2 


28 


4 


6 


15 


2 


26 


3 


6 


14 


2 


23 


2 


4 


11 


0 


20 


1 


2 


7 


0 


13 


Means 


8.47 


17.30 


2.87 


28.60 



Group 11 

(777 students in 14 colleges) 



9 


16 


29 


8 


49 


8 


14 


24 


6 


41 


7 


12 


21 


4 


35 


6 


10 


19 


3 


31 


5 


8 


18 


2 


27 


4 


6 


15 


2 


24 


3 


6 


13 


0 


21 


2 


4 


11 


0 


18 


1 


2 


7 


0 


13 


Means 


8.70 


17.80 


3.14 


29.32 



Group 12 

(141 students in 7 colleges) 



9 


22 


36 


11 


65 


8 


20 


33 


9 


59 


7 


19 


30 


8 


53 


6 


16 


25 


6 


48 


5 


14 


23 


6 


43 


4 


12 


20 


4 


36 


3 


10 


18 


3 


32 


2 


8 


16 


2 


26 - 


1 


5 


12 


0 


21 


Means 


13.98 


23.62 


3 a 63 


42.97 



O 
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FRENCH AURAL COMPREHENSION NORMS 
LOWER LEVEL FORM B 



DECOLES 


IPT. I 


PT. n 


PT.m 


[ total 


DECILES 


iPT. r 


PT.II 


PT . HI 


TOTAL 




(2S) 


(so) 


(39) 


(90) 




( 29) 


(so) 


(39) 


(80) 




Group IB 






Group 2 






(71 Students in 


1 college) 


(54 students in 1 college) 


9 


12 


21 


16 


43 


9 


12 


22 


19 


43 


8 


10 


18 


11 


38 


8 


10 


18 


16 


39 


.7 


8 


15 


11 


31 


7 


8 


17 


14 


35 


6 


7 


14 


9 


29 


6 


8 


15 


11 


31 


5 


6 


14 


8 


27 


5 


6 


13 


9 


27 


4 


5 


12 


7 


25 


4 


5 


11 


8 


25 


3 


4 


9 


4 


21 


3 


4 


10 


7 


22 


2 


2 


8 


3 


18 


2 


2 


9 


5 


19 


1 


1 


7 


1 


15 


1 


2 


6 


3 


17 


Means 


6.62 


13.03 


8.02 


27.46 


Means 


6e 85 


13.54 


10.46 


30.85 



FRENCH AURAL COMPREHENSION NORMS 
UPPER LEVEL FORM B 



DECDLES 


PT.I 


PT.M 


PT. nn 


TOTAL 


DEC9LES 


PT.l 


PT.n 


PT. in 


TOTAL 




(29) 


(40) 


(19) 


(80) 




(29) 


(40) 


(19) 


(80) 




Group 11 








Group 12 




(344 students in 


5 colleges) 


(104 students in 


3 colleges) 


9 


10 


20 


9 


34 


9 


15 


28 


11 


53 


8 


8 


17 


8 


29 


8 


14 


24 


10 


44 


7 


7 


14 


6 


25 


7 


12 


22 


9 


39 


6 


6 


12 


5 


22 


6 


11 


18 


8 


35 


5 


5 


11 


4 


19 


5 


9 


16 


7 


31 


4 


4 


9 


3 


17 


4 


8 


13 


6 


28 


3 


3 


7 


2 


15 


3 


7 


11 


4 


24 


2 


2 


5 


0 


12 


2 


6 


8 


2 


20 


1 


0 


3 


0 


9 


1 


4 


6 


0 


15 



Means 5.17 11.30 4.38 20.62 



Means 9.64 16.56 6.56 32.71 



NORMS FOR TESTS 



307 



GERMAN AURAL COMPREHENSION NORMS 
^ LOWER LEVEL FORM A 



DECILES PT.I FT.M PT.EI TOTAL 
(25) (25) (3t) («fi) 



Group OB 

(160 students in 6 schools) 



9 


14 


13 


19 


43 


8 


9 


8 


13 


28 


7 


7 


6 


9 


20 


6 


5 


4 


8 


15 


5 


4 


4 


5 


12 


4 


2 


2 


3 


10 


3 


1 


1 


2 


8 


2 


0 


0 


1 


6 


1 


0 


0 


0 


3 


Means 


5.27 


4.95 


7.42 


17.47 


Group OD 

(32 students in 4 schools). 


9 


16 


14 


26 


47 


8 


14 


12 


15 


40 


7 


13 


n- 


14 


35 


6 


12 


10 


10 


34 


5 


10 


7 


8 


26 


4 


7 


6 


7 


20 


3 


6 


5 


3 


14 


2 


.4 


4 


1 


10 


1 


2 


1 


0 


7 


Means 


9.41 


8.12 


10.00 


27.25 


(470 


Group IB 

students in 13 colleges) 


9 


14 


16 


22 


47 


8 


12 


12 


16 


37 


7 


9 


10 


13 


30 




7 


8 


10 


23 


5 


6 


7 


8 


19 


4 


4 


6 


6 


16 


3 


3 


4 


4 


12 


2 


2 


2 


2 


9 


1 


0 


0 


1 


6 


Means 


6.78 


7.26 


9.64 23.41 



OECIILES PT.I IFT.n PT.IE TOTAL 
(25) (25) (35) (85) 



Group OC 

(32 students in 1 school) 



9 


14 


12 


11 


29 


8 


8 


7 


9 


20 


7 


6 


5 


7 


14 


6 


2 


4 


3 


11 


5 


1 


2 


3 


8 


4 


0 


1 


2 


5 


3 


0 


1 


2 


4 


2 


0 


0 


2 


3 


1 


0 


0 


1 


1 


Means 


3.88 


4.12 


5.32 


13.09 


Group iA 

(300 students in 3 colleges) 


9 


12 


12 


17 


35 


8 


8 


8 


10 


23 


7 


6 


6 


8 


19 


6 


4 


5 


7 


16 


5 


'4 


4 


5 


13 


4 


2 


2 


4 


10 


3 


1 


2 


2 


8 


2 


0 


1 


1 


6 


1 


0 


0 


0 


2 


Means 


4.74 


4. 68 


6.70 


15.82 


Group 1 
(171 students in 


6. colleges) 


9 


15 


16 


21 


49 


8 


13 


13 


18 


39 


7 


10 


11 


15 


33 


6 


8 


8 


12 


29 


5 


8 


7 


9 


23 


4 


7 


6 


8 


19 


3 


6 


4 


4 


15 


2 


2 


2 


2 


11 


1 


1 


1 


1 


8 


Means 


8.25 


8.10 


10.62 


26.53 



1 
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GERMAN AURAL COMPREHENSION NORMS 
UPPER LEVEL FORM A 



DECILES 


fT.I 


IPT.II 


pT.m 


TOTAL 




(2S) 


(40) 


(IS) 


(•0) 


(22 ctudent* in 


2 achoola) 


9 


13 


27 


9 


46 


8 


12 


23 


8 


41 


7 


10 


21 


8 


37 


6 


9 


19 


6 


35 


5 


7 


13 


4 


23 


4 


6 


7 


3 


17 


3 


2 


6 


2 


11 


2 


0 


3 


0 


5 


1 


0 


1 


0 


3 


Mean* 


6.86 


14.22 


5.09 25.81 



(84 


students in 


3 colleges) 


9 


13 


30 


10 


53 


8* 


10 


23 


9 


40 


7 


7 


19 


8 


29 


6 


6 


16 


6 


26 


5 


6 


13 


6 


22 


4 


4 


12 


4 


19 


3 


2 


9 


4 


16 


2 


2 


7 


3 


14 


1 


0 


4 


2 


12 


Mean* 


5.90 


15.22 


5.95 


26.89 







I 
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RUSSIAN AURAL COMPREHENSION NORMS 
LOWER LEVEL FORM A 



(157 students in 11 colleges) 



DECUlLES 


PT. 1 


iPT.n 


PT. m 


TOTAL 




(29) 


(29) 


(91) 


(•«) 


9 


21 


22 


32 


72 


8 


18 


19 


28 


65 


7 


13 


17 


23 


49 


6 


10 


15 


19 


42 


5 


8 


13 


17 


37 


4 


7 


11 


15 ' 


32 


3 


6 


10 


12 


26 


2 


4 


8 


9 


22 


1 


1 


6 


5 


17 


Means 


9.83 


13.32 


17.90 


40.78 



RUSSIAN AURAL COMPREHENSION NORMS 
UPPER ,LEVEL FORM A 



(60 students in 7 colleges) 



DECILES 


PT. I 


pT.n 


PT.ni 


TOTAL 




(25) 


(34) 


(15) 


(74) 


9 


18 


31 


15 


62 


8 


16 


28 


12 


55 


7 


14 


26 


10 


SO 


6 


12 


25 


10 


48 


5 


12 


23 


9 


41 


4 


10 


20 


8 


37 


3 


8 


16 


4 


32 


2 


6 


14 


3 


27 


1 


4 


11 


2 


19 


Means 


11.17 


21.68 


7.97 


41.05 
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■j 



j 

\ 

! 



!: 



f 



SPANISH AURAL COMPREHENSION NORMS 
LOWER LEVEL FORM A 



DECILES 


rr.i 


PT.n 


PT.in 


TOTAL 


DECILES 


IPT. 1 


PT.E 


PT. m 


TOTAL 




(25) 


( 25) 


(3t) 


(it) 




(25) 


(25) 


(3S) 


(••) 




Group OA 






Group OB 






(355 


students in 


5 schools) 


(743 students in 11 schools) 


9 


8 


12 


17 


31 


9 


8 


12 


17 


31 


8 


6 


10 


13 


26 


8 


7 


10 


14 


26 


7 


5 


8 


11 


23 


7 


6 


8 


11 


22 


6 


4 


7 


10 


20 


6 


4 


7 


9 


20 


5 


3 


6 


8 


17 


5 


3 


6 


7 


17 


4 


2 


5 


6 


15 


4 


2 


5 


5 


14 


3 


1 


4 


5 


13 


3 


1 


4 


3 


12 


2 


0 


2 


3 


10 


2 


0 


2 


0 


9 


1 


0 


1 


1 


8 


1 


0 


1 


0 


6 


Means 


3.61 


6.53 


8.76 


18.70 


Means 


3.75 


6.51. 


8.14 


18.18 






Group OC 






Group OD 




(158 


students in 


3 schools) 


(365 students in 


10 schools) 


9 


10 


14 


21 


39 


9 


14 


16 


23 


47 


8 


8 


12 


18 


34 


8 


10 


14 


18 


40 


7 


6 


10 


15 


30 


7 


8 


12 


15 


35 


6 


6 


10 


13 


28 


6 


7 


12 


13 


30 


5 


4 


8 


11 


24 


5 


6 


10 


11 


26 


4 


4 


7 


10 


22 


4 


4 


8 


10 


24 


3 


2 


6 


8 


19 


3 


4 


8 


8 


20 


2 


2 


6 


5 


15 


2 


2 


6 


6 


17 


1 


0 


3 


3 


11 


1 


0 


4 


3 


12 


Means 


4.87 


8.40 


11.86 24.94 


Means 


6.41 


10.41 


12.00 


28.34 






Group OE 






Group OF 




(27 


students in 


2 schools) 


(36 students in 


3 schools) 


9 


17 


18 


25 


51 


9 


20 


22 


29 


69 


8 


12 


16 


19 


43 


8 


19 


20 


27 


65 


7 


10 


14 


17 


40 


7 


16 


19 


25 


59 


6 


7 


13 


13 


31 


6 


15 


18 


23 


55 


5 


6 


10 


12 


29 


5 


14 


16 


22 


52 


4 


4 


10 


11 


25 


4 


13 


16 


17 


47 


3 


3 


8 


10 


22 


3 


12 


16 


16 


44 


2 


2 


7 


' 5 


19 


2 


11 


13 


14 


39 


1 


0 


5 


4 


13 


1 


10 


11 


9 


34 


Means 


7.33 


11.67 


13.68 


32.30 


Means 


14.80 


17.08 


20.22 


51.94 






i! 



1 



o 
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SPANISH AURAL COMPREHENSION NORMS 
LOWER LEVEL FORM A 



DECILES 


PT.X 

(ES) 


PT.n 

(ss) 


PT. HI 

(3») 


TOTAL 

(••) 


DECOLES 


PT.I 

(2S) 


PT. H 

(as) 


pT.in 

(3S) 


TOTAL 

(Si) 


(31 a 


Group lA 
tudenta in 2 


collegea) 


(1412 


Group IB 

atudenta in 22 collegea) 


9 


8 


13 


17 


33 


9 


12 


17 


23 


47 


8 


7 


10 


16 


27 


8 


9 


14 


19 


39 


7 


6 


8 


15 


25 


7 


7 


13 


17 


34 


6 


4 


7 


12 


23 


6 


6 


12 


15 


31 


S 


4 


6 


11 


21 


5 


5 


10 


13 


28 


4 


4 


6 


10 


20 


4 


4 


9 


11 


25 


3 


2 


4 


8 


18 


3 


2 


8 


10 


22 


2 


1 


4 


6 


16 


2 


2 


6 


7 


19 


1 


0 


4 


S 


13 


1 


0 


4 


4 


14 


Me ana 


4.39 


7.22 


11.46 


22.90 


Me ana 


5; 64 


10.48 


13.42 


29.38 




Group 2 

















(5^2 atudenta in 16 collegea) 



9 


16 


20 


27 


59 


8 


12 


18 


23 


50 


7 


10 


16 


20 


43 


6 


8 


14 


17 


38 


5 


7 


12 


16 


34 


4 


6 


11 


13 


29 


3 


4 


10 


11 


26 


2 


2 


8 


9 


22 


1 


1 


6 


5 


17 


Me ana 


7.67 


12.86 


15.68 


35.98 
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ERIC 



SPANISH AURAL COMPREHENSION NORMS 
UPPER LEVEL FORM A 



Group lOG/H 

(47 students in 3 schools) 



9 


18 


35 


10 


58 


8 


16 


32 


8 


53 


7 


13 


28 


6 


46 


6 


10 


26 


4 


40 


5 


9 


25 


4 


37 


4 


8 


21 


3 


33 


3 


5 


19 


2 


?9 


2 


3 


15 


1 


25 


1 


2 


14 


0 


20 


Means 


9.83 


24.54 


4.66 


38.78 



DCCIILE8 


PT.I 


PT.n 


PT.m 


TOTAL 


DECILES 


PT.I 


PT.n 


PT.m 


TOTAL 




(29) 


(49) 


(19) 


(99) 




(29) 


(49) 


(19) 


(99) 1 




Group IOC 






Group lOD 




(61 students in 


3 schools) 


(418 students in 6 schools) 


9 


12 


24 


6 


36 


9 


13 


25 


8 


38 


8 


10 


22 


4 


33 


8 


10 


21 


6 


33 


7 


9 


20 


3 


31 


7 


8 


18 


4 


30 1 


♦ 6 


7 


19 


2 


28 


6 


8 


16 


3 


26 1 


5 


6 


16 


2 


26 


5 


7 


14 


3 


23 


4 


6 


15 


0 


23 


4 


6 


12 


2 


20 1 


3 


4 


13 


0 


19 


3 


4 


9 


2 


17 


2 


2 


9 


0 


16 


2 


4 


7 


0 


14 1 


1 


1 


5 


0 


11 


1 


2 


3 


0 


10 1 


Means 


7.06 


16. 10 


2.31 


25.42 


Means 


7.14 


14.02 


3.13 


24. 10 1 

1 




Group 10E 






Group iOF 




(63 


students in 2 schools) 


(140 student.'^ in 


8 schools) 


9 


10 


25 


6 


37 


9 


16 


28 


8 


45 


8 


9 


23 


4 


31 


8 


13 


24 


6 


41 


7 


8 


21 


4 


29 


7 


12 


21 


6 


36 


6 


7 


19 


3 


27 


6 


10 


19 


4 


33 


5 


6 


16 


3 


25 


5 


8 


17 


4 


30 


4 


5 


15 


2 


24 


4 


8 


15 


3 


27 1 


3 


4 


14 


2 


21 


3 


7 


14 


3 


25 i 


2 


2 


11 


0 


20 


2 


6 


11 


2 


22 1 


1 


0 


9 


0 


16 


1 


4 


8 


0 


17“ 1 

I 


Means 


6.28 


17.16 


3.06 26.50 


Means 


9.48 


17.46 


4.14 30.94 1 



NORMS FOR TESTS 



SPANISH AURAL COMPREHENSION NORMS 



1 UPPER LEVEL 


FORM A 


1 DECILES 


fT.I 


PT. m 


PT.m 


TOTAL 


1 


( 2S) 


(45) 


( IS) 


(85) 


j 


Group 11 




1 (1044 


students in 


19 colleges) 


1 9 


16 


33 


9 


53 


i 8 


13 


28 


8 


46 


! 7 


12 


26 


6 


40 


! 6 


10 


24 


4 


37 


i 5 


8 


21 


4 


34 


! 4 


8 


20 


3 


31 


1 ^ 


6 


17 


2 


28 


2 


5 


15 


2 


24 


1 


2 


11 


0 


20 


Means 


9.37 


21.68 


4.34 


35.22 



Group 12 

(302 students in 10 colleges) 



9 


20 


35 


9 


61 


8 


16 


31 


7 


52 


7 


14 


28 


6 


47 


6 


13 


27 


4 


42 


5 


12 


25 


4 


38 


4 


10 


21 


3 


35 


3 


8 


20 


2 


31 


2 


6 


17 


2 


27 


1 


4 


14 


0 


22 


Means 


11.48 


24.29 


4.36 


40.06 
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SPANISH AURAL COMPREHENSION NORMS 
LOWER LEVEL FORM B 



PECILES 


ri. I 

(25) 


PT.n 

(25) 


PT.m 

OS) 


TOTAL 

(SS) 


(141 


Group IB 
students in 4 


colleges) 


9 


1.3 


16 


23 


47 


8 


JiO 


14 


20 


43 


7 


9 


12 


18 


38 


6 


8 


10 


16 


33 


5 


6 


9 


14 


30 


4 


5 


8 


13 


27 


3 


4 


7 


11 


23 


2 


2 


6 


9 


18 


1 


0 


2 


6 


14 


Means 


6.69 


9.40 


14.44 


30.33 



DECILES 


rt. I 

( 25) 


PT.n 

(25) 


PT.ni 

(38) 


TOTAL 

(SS) 


Group 2 

(165 students in 3 


colleges) 


9 


18 


19 


28 


63 


8 


15 


18 


24 


53 


7 


13 


16 


22 


48 


6 


12 


14 


19 


43 


5 


10 


12 


16 


36 


4 


8 


10 


14 


32 


3 


6 


9 


10 


28 


2 


4 


7 


9 


23 


1 


3 


4 


5 


18 


Means 


10.09 


12.10 


16.48 


38.66 



SPANISH AURAL COMPREHENSION NORMS 
UPPER LEVEL FORM B 



DECOLES 


PT.I 

(25) 


PT.n 

(44) 


PT.m 

(15) 


TOTAL 

(S4) 


(303 


Group 11 
students in 3 


colleges) 


9 


15 


16 


10 


38 


8 


13 


13 


? 


32 


7 


12 


11 


8 


28 


6 


10 


9 


8 


25 


5 


10 


7 


7 


22 


4 


8 


5 


5 


20 


3 


7 


4 


4 


17 


2 


6 


2 


2 


.14 


1 


3 


1 


0 


10 



DECILES 


PT.I 
( 25) 


PT.n 

(44) 


PT.m 

05) 


TOTAL 

(S4) 


(127 


Group 12 
students in 4 


colleges) 


9 


19 


26 


14 


56 


8 


18 


22 


12 


47 


7 


16 


19 


10 


44 


6 


15 


17 


9 


40 


5 


14 


15 


9 


37 


4 


13 


12 


8 


33 


3 


12 


10 


6 


28 


2 


10 


8 


4 


24 


1 


7 


4 


2 


18 



Means 



9.29 8.10 6.04 23.86 



Means 



13.53 14.72 8.16 36.18 
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RUSSIAN READING -VOCABULARY -GRAMMAR 

TEST NORMS 

(173 students in 7 colleges) 



DECILES 


READ. 

(45) 


voc. 

(40) 


GRAM. 

(40) 


TOTAL 
( (25) 


9 


39 


27 


30 


92 


8 


31 


21 


27 


80 


7 


26 


17 


23 


65 


6 


21 


15 


19 


55 


5 


17 


13 


17 


45 


4 


15 


9 


15 


40 


3 


12 


8 


11 


30 


2 


9 


6 


10 


25 


1 


5 


4 


7 


18 


Means 


19.82 


13.94 


17.74 


51.00 







Appendix B 



Charts of Co-operative and 
Aural Test Data 



The following charts contain all Q>-operative and aural 
scores obtained from the colleges and secondary school-s which 
collaborated specially with the Investigation, and whose 
programs are discussed in Chapters V and VI of the present 
volume. In cases where scores of both experimental and con- 
ventional groups appear in the same chart (e.g. extensively 
for College J), experimental groups are distinguished from 
their conventional counterparts by the symbol X- preceding 
their group number. Thus for example, in College J French, 
Experimental Group la is designated as X-la, as contrasted 
with Conventional Group la, etc. 
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COLLEGE A 



S 

P 

A 

N 

I 

S 

H 



F 

R 

E 

N 

C 

H 



GROUP 


HRS. 

PER 

WX. 


H 


OATE 


TOTAL 

HRS. 


CO* OPERATIVE 
MEAN %ILE 


AURAL 

MEAN TENTH 


DATE 


total 

HRS. 


CO*OPERATlVE 
MEAN KILE 


AU«A?. 1 

MEAN TENTH | 








JAN. 


75 


FORM P 


1 YR. 


LOWER ■ 




MAY 


150 


FORM 0 


1 YR. 


LOWER A 


IR 


1 


s 


•A 


1347 




R 43.4 


13 


I 3.5 




1347 




R 60.9 


77 


I 4.0 














V 43.7 


11 


I 4.7 


. 






V 59.4 


64 


.1 8.8 


4 












G 45.6 


25 


M 7.8 


. 






G 54.6 


61 


B 14.0 


6 












T 43.8 


13 


T 16.1 


- 






T 59.2 


68 


T 26.7 


4 - i 








OCT. 


150^ 


FORM P 


1 YR. 


LOWER S 


11 


MAY 


370 


FORM 0 


2 YRS. 


LOWER A 


3 


t 


4 


It 


1343 




R 59.4 


71 


I 8.4 


6 


1347 




h 66.2 


51 


I 8.6 














V 52.6 


39 


1 9.9 


6 






V 63.4 


35 


I 13.8 


6 












G 56.0 


65 


M 13. 6 


5 






G 66.2 


64 


B 18. 6 


7 












T 56.74 


60 


T 32.04 


6 






T 66.94 


53 


T 41.0* 


7 


t. 1# 




33 






R 58.9 


71 


1 8.4 


6 






R 64.6 


47 


I 7.8 














V 51.8 


35 


1 8.9 


5 






V 60.9 


28 


I 13.2 


6 ’ 












G 53.7 


57 


11 12.9 


4 






G 63.8 


56 


B 18.4 


7 












T 55.6 


56 


T 30.2 


5 






T 64.6 


44 


T 39.4 


7 








JAN. 


300 


FORM P 


3 YRS. 


LOWER ■ 


2 


MAY 


330 


FORM 0 


3 YRS. 


LOWER A 


3 1 


3 


Z 


13 


1347 




R 74.2 


52 


I 13.6 


8 


1347 






















V 71.1 


32 


I 15.9 


7 
























G 72.7 


74 


n 20.0 


7 
























T 75.0 


55 


T 49.5 


7 














3. 1# 




7 






R 75.0 


57 


I 11.4 


5 






R 70.9 


40 


I 11.1 


8 












V 66.3 


16 


1 14.9 


6 






V 74.9 


47 


M 17. 6 


8 












G 71.1 


67 


B 16. 6 


5 






G 70.3 


64 


B 21.9 


8 












T 73.0 


47 


T 42.9 


6 






T 74.1 


51 


T 50.6 


8 








JAN. 


73 


FORM 0 


1 YR. 


LOWER R 




MAY 


150 


FORM R 


1 YR. 


LOWER A 


IS 


1 A 


s 


31 


1347 




R 45.5 


19 


I 4.2 




1347 




R 59.1 


66 


I 5.1 


6 












V 57.2 


39 


1 10.7 


. 






V 60.0 


52 


n 13.0 


7 












G 52.9 


45 


M 6. 1 


. 






G 60.8 


76 


B 10.2 


5 












T 51.9 


32 ^ 


T 21.0 


- 






T 61.0 


67 


T 28.4 


7 








JAN. 


30 


FORM 0 


1 YR. 


LOWER R 


It 


may 


1RO 


FORM R 


1 yr. 


LOWER A 




IR 


$ 


la 


1347 




R 42.6 


13 


I 2.9 


3 


1347 




R 65.4 


84 


I 3.3 


4 












V 49.8 


16 


n 8.1 


2 






V 60.3 


53 


1 9.1 


4 












G 52.0 


40 


M 6. 3 


4 






G 59.8 


73 


M 10.0 


5 












T 47.9 


19 


T 17.3 


2 






T 63.1 


74 


T 22.4 


4 




















MAY 


150 


INV. 


TENTH 


LOWER A 




1 


s 


12 














1347 




R 13.7 


3 


I 4.7 


3 
























V 5.3 


1 


I 10.8 


























G 9.8 


3 


B 16.8 


























T 28.8 


2 


T 32.3 










JAN. 


210 


INV. 


TENTH 


LOWER A 




MAY 


370 


INV. 


TENTH 


LOWER A 




Z 


4 


3 


1347 




R 13.0 


3 


1 2.3 


2 


1347 




R 16.7 


5 


I 2.7 


2 












V 9.8 


5 


1 8.3 


2 






V 11.7 


5 


1 4.7 


1 5 












G 8.8 


2 


M 6.0 


2 






G 10.7 


3 


B 1().7 


3 j 












T 31.7 


3 


T 16.7 


1 






T 39.0^ 4 


T 18. Of 


? V 



R 

U 

s 

s 

I 

A 

N 



HOr the high-echool equivalent. 

♦Excluding Subgroup 2.1, totnl means are, for 150 hrs.: Co-operative 57.9, aural 32.5; for ?70 hrs.: 
Co-operative 70.0, aural 42.9. 

iTwonty-one members of this subgroup had taken (Form A) in May 1946 at 150 hrs., 

with the following mean acorea: I 7.2, E 12.9, II 13.1, T 33.1. 

•fhia subgroup continued through 30 more hrs. and was tested again in May 1947. 

^Only three of the group completed the 270 hrs. Total mean scores for these three at 210 hrs. had been: 
reading, 30.3; aural, 17. 3. 
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COLLEGE B 

Conventions 1 


' — 
GROUP 


HRS* 

PCS 

WK. 


M 


DATS 


TOTAL 

HRS. 


CO-OPERATIVE 
MEAN KILE 


AURAL 

MEAN TENTH 


DATE 


TOTAL 

HRS. 


CO-OPERATIVE 
MEAN KILE 


AURAL 

MEAN TENTH 






















OCT. 


145 


FORM R 


S YRS. 


UPPER A 


1 1 




lA 


3 


SO 














1345 




R 64.7 


40 


1 


6.4 


4 


























V 66.9 


28 


I 


16.4 


5 


























G 63.9 


61 


M 


3.1 


6 


























T 66.6 


42 


T 


25.9 


4 










OCT. 


105* 


FORM R 


1 YR. 


UFFER A 


1 1 


APR. 


ISO 


PORM R 


Z YRS. 


UPPER B 


1 1 




8S 


S 


7S 


1345 




R 62.8 


78 


I 5.6 


4 


I34S 




R 71.8 


67 


I 


4.0 


4 














V 66.6 


77 


I 15.8 


5 






V 71.6 


47 


I 


11.2 


5 














G 66.0 


89 


II 2.3 


5 






G 68.0 


76 


TfUTT 


4.0 


5 


F 












T 66.7 


85 


T 23.7 


4 






T 72.7 


65 


T 


19.2 


5 


R 








PCS. 


35* 


FORM R 


1 YR. 


LONER R 


IB 


JUNE 


140 


FORM R 


Z YRS. 


LOWER A 


z 


: E 


tc 


3 


S3 


134S 




R 58. 3 


63 


I 8.0 


7 


1 345 




R 68.9 


61 


I 


8.4 


7 














V 66.3 


76 


E 14.7^ 


7 






V 71.0 


45 


I 


14.8 


6 


w 












G 62.7 


83 


imr 7.6 


5 






G 66.9 


72 


Tnf 


12.7 


6 


c 












T 63.8 


76 


T 30.3 


7 






T 71.0 


59 


T 


35.9 


6 


H 








OCT. 


H.S. 


FORM R 


S YRS 


. UFFER A 


It 


APR. 


H.S. 


FORM R 


S YRS. 


UPPER B 


IS 




SA 


3 


17 


I34S 


+ 15 


R 79.9 


89 


I 13.9 


5 


I34S 


+70 


R 85.6 


85 


I 


8.6 


5 














V 76.8 


68 


1 23.1 


5 






V 79.2 


40 


M 


18.4 


6 














G 67.8 


75 


M 2.7 


3 






G 70.8 


73 


li 


7.3 


5 














T 76.9 


Bi 


T 39.7 


5 






T 82. 1 


72 


T 


34.3 


6 






















APR. 


SS5 


FORM R 


9 YRS. 


UPPER B 


IS 




S» 


3 


1 « 














I34S 




R 81.9 


75 


I 


7.7 


4 


























V 79.4 


40 


1 


17.1 


5 


























G 74.5 


84 


M 


4.3 


3 


























T 81.5 


70 


T 


29.1 


4 






















NOV. 




FORM Q 


Z YRS. 


UPPER A 


II 


■ 


ZA 


3 


S3 














1345 




R 65.8 


50 


I 


9.0 


5 


























V 65.0 


42 


I 


22.1 


6 


c 
























G 67 . 0 


68 


HI 


3.4 


4 


o 
























T 67.5 


55 


T 


34.5 


5 


P 








HOV. 


105* 


FORM 0 


1 YR. 


UPPER A 


1 1 


APR. 


ISO 


FORM 0 


Z YRS. 


UPPER A 


1 1 


A 


SB 


3 . 


IS7 


tl34S 




R 59.9 


74 


1 5.5 


4 


I34S 




R 66.8 


54 


I 


8.1 


5 


N 












V 59.3 


65 


M 18. 8 


4 






V 66.3 


48 


M 


24.9 


6 














G 61.9 


85 


M 3.7 


5 






G 66 . 8 


67 


nr 


4.8 


6 


I 












T 61.5 


77 


T 28.0 


4 






T 68.4 


59 


T 


37.8 


6 


s 








PEB. 


3S* 


FORM 0 


1 YR. 


LOWER il 


IB 


JUNE 


140 


FORM 0 


Z YRS. 


LOWER A 


s 


H 


SC 


3 


IS 


I34S 




R 60.0 


74 


I 8.6 


7 


I34S 




R 66.6 


54 


I 


,9.9 


7 














V 58.2 


61 


I 11.0 


6 






V 67.0 


50 


1 


14.4 


6 














G 59.5 


77 


II 18. 7 


7 






G 63. 3 


53 


n 


20.4 


7 














T 60.2 


73 


T 38.3 


7 






T 67.3 


54 


T 


44.7 


8 



Mr thm high- school oquiTsiont. 
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1; 

1 COLLEGE 


D 


GROUP 


HRS. 

PER 

WK. 


N 


DATE 


TOTAL 

HRS. 


CO-OPERATIVE 
MEAN %ILE 


AURAL 

MEAN TENTH 


HRS. 

PER 

WK. 


N 


DATE 


TOTAL 

HRS. 


AURAL 

MEAN TENTH 












JAN. 


90 


FORM Q 


1 YR. 


LOWER A 


IS 






MAY 


130 


LOWER A 


11 


F 




1 


• 


77 


1f4« 




R 48.0 


26 


I 


3.2 


4 


6 


30 


1943 




I 


3.6 


5 


H 














V 60.0 


52 


1 


8.5 


3 










M 


11.5 


5 


E 














G 59.8 


73 


M 


9.2 


5 










M 


12.2 


7 


N 














T 56.3 


47 


T 


20.9 


4 










T 


27.3 


5 










JAN. 


2aoA 


FORM 0 


2 YRS. 










MAY 


340 


LCWER A 


2 


C 




2 


f 


33 


1f4« 




R 72.8 


71 








4 


33 


194I 




I 


3.5 


4 


H 














V 77.2 


70 
















1 


13.9 


5 
















G 67.7 


75 
















M 


12.6 


5 


i 














T 74.7 


73 
















T 


30.0 


5 


'i 

1 










JAN. 


90 


FORM P 


1 YR. 


LOWER A 


!■ 






MAY 


190 


LOWER A 


IB 


f ^ 




1 


f 


34 


194« 




R 51.9 


34 


I 


4.8 


5 


3 


30 


1943 




I 


10.4 


8 


1 ‘ G 














V 54.9 


44 


1 


6.1 


4 










I 


9.9 


7 


1 ^ 














G 52.9 


51 


M 


6.5 


4 










M 


13.0 


7 


1 H 

h', 














T S3. 2 


40 


T 


17.4 


5 










T 


33.3 


8 










JAN. 


2tO* 


FORM P 


2 YRS. 












MAY 


340 


LOWER A 


2 


1 M 




2 


• 


12 


1943 




R 69.1 


58 








4 . 


1 2 


1943 




I 


5.8 


3 


[ ii 














V 65.8 


43 
















I 


7.9 


6 


N 














G 54.1 


19 
















M 


7.0 


4 
















T 64.0 


37 
















T 


20.8 


5 












JAN. 


90 


FORM 0 


1 YR. 


LOWER A 


II 






MAY 


130 


LOWER A 


IB 


S 




1 


• 


40 


1943 




R 52.3 


42 


I 


3.2 


4 


3 


20 


1943 




I 


7.2 


7 


P 














V 51.2 


32 


1 


8.3 


3 










I 


10.8 


6 


A 














G 54.3 


57 


M 


10.4 


3 










M 


15.8 


7 


N 














T 52.7 


44 


T 


22.0 


3 










T 


33.8 


7 










JAN. 


230^ 


FORM 0 


2 YRS. 












MAY 


340 


LOWER A 


2 


I 




2 


• 


47 


1943 




R 59.7 


26 • 






5 


4 


47 


1943 




I 


8.5 


6 


S 














V 61.3 


28 
















H 


15.3 


7 


H 














G 73.9 


89 
















M 


16.0 


6 
















T 66.2 


49 
















T 


39.8 


7 



40r the high-school equivalent. 
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COLLEGE C 

June 1946 


MRS. 

PER 

aROUP WK. N 


TOTAL CO-OPERATIVE AURAL 

HRS. MEAN SILE MEAN TENTH 


1 

Further Aural Notes 


Spanish t s s« 


90 FORM P 1 YR. LOWER B IB 

R 60.1 74 I 5.7 5 

V 59.1 64 I 8.5 5 

G 66.7 94 M 13.6 5 

T 63.4 82 T 27, 8* 5 


1) Twenty- two of these (*27.2) 

took Aural Lower A at 135 
hrs. in Jan. 1947. Total 
mean : 37.1 (6th tenth) . 

2) Twelve others (*23.7) took 

Aural Upper A at 180 hrs. in 
Jan. 1947. Total mean: 30.5; 
(4th tenth). 


French * s ss 


FORM 0 2 YRS. LOWER B 2 

*** R 63.9 38 I 6.9 6 

V 69.7 38 H 13.8 5 

G 61.2 49 M 10.5 6 

T 66.5 41 T 31.1* 6 


1) Nineteen of these (*32.4) took 

Aural Upper A at 180 hrs. ini 
Sept. 1946. Total mean: 
44.2 (9th tenth). 

2) Fourteen others (*27.4) tooki 

Aural Upper A at 180 hrs. in; 
Jan. 1947. Total mean: 26.3 !; 
(4th tenth). j 


Spanish t 3 ss 


138 FORM P 2 YRS. LOWER B 2 

R 66.5 53 I 9.8 5 

V 64.3 40 1 12.8 5 

G 69.2 76 m 17.6 6 

T 68.6 59 T 40.2* 6 


1) Eleven of these (*50.5) had 

taken Aural Lower A at 90 |i 
hrs. in Feb. 1946. Total !; 
mean: 34.3 (7th tenth). 

2) Four of the above eleven (*5l,5); 

took Aural Upper A at 180 j| 
hrs. in Jan. 1947. Total;; 
mean : 32.3 (5th tenth) . 1 

3) Eleven others (*38.0) took! 

Aural Upper A at 180 hrs. in; 
Jan. 1947. Total mean: 37,9j| 
(6th tenth). j 


French 3 3 23 


ISO FORM 0 2 YRS. UPPER B It 

R 65.5 43 I 4.1 4 

V 70.1 40 I 9.5 5 

G 62.0 52 M 3.3 4 

T 67.0 43 T 16. 9* 4 


1) Thirteen of these (*19.6) had^ 
taken Aural ILower A at 135, 
hrs. in Feb. 1946. Total 
mean : 33.6 (5th tenth) • 


Spanish 3 3 25 


ISO FORM P 2 YRS. UPPER B It 

R 69.4 65 I 11.1 5 

V 67.9 54 H 7.9 6 

G 69.7 78 m 5.1 4 

T 70.8 68 T 24.1* 6 


1) Fifteen of these (*25.3) had 

taken Aural Lower A at 135 
hrs. in Feb. 1946. Total 
mean: 41.8 (sic) (7th tenth). 

2) Five of the above fifteen 

(*25.8) took Aural Upper A 
at 225 hrs, in Jan. 1947.1 
Total mean: 41.8 (sic) (5thi 
tenth). 

3) One other (*22.0) took Aurall 

Ibper A at 225 hrs. in Jan.i 
I$47. Total score: 58.01 
(8th tenth ) . { 


French 4 3 27 


225 form Q 3 YRS. UPPER B It 

R 82.1 75 I 9.6 6 

V 79.6 41 H 17.1 5 

G71.1 74 M 6.7 5 

T 80.6 66 T 33.3* 6 


1) Five of these (*41.2) took! 

Aural l^per A after 45 more! 
hrs. in Sept. 1946. Total! 
mean: 59.0 (8th tenth). , 

2) Five others (*47.8) took Aurall 

Upper A after 45 more hrs.|| 
in Jan. 194*^. Total mean:! 
58.4 (8th tenth). [ 


Spanish 4 3 30 


225 form P 3YRS. UPPER B t2 

R 73.6 50 I 15.1 5 

more y YY 4 5g jj jg 9 g 

G 75.3 81 M 8.8 5 

T 78.0 67 T 40.9* 6 


1) Seven of these (*39.1) tooki 
Aural Upper A after 45 more! 
hrs. in Jan. 1947. Totalj 
mean: 46.3 (6th tenth)^ | 
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COLLEGE E 


GROUP 


HRS, 

PER 

WX, 


N 


DATE 


TOTAL 

HRS. 


CO«OPERATlVE 
MEAN RILE 


AURAL 

MEAN TENTH 










MAY 


1 SS 


rORM R 


1 YR, 


tOWER A 


1 ■ 


French 


1 




t07 


IS4S 




R 57.1 


59 


1 3.8 


5 














V 56.5 


35 


I 10.2 


4 














G 56.0 


57 


n 7.9 


4 














T 57.7 


55 


T 21.9 


4 










MAY 


ISi 


RORM 0 


1 VR. 


tOWER A 


1 ■ 


Sjpmiah 


1 




Its 


1 S4S 




R 61.8 


80 


I 5.9 


6 














V 57.5 


60 


1 11.3 


6 














G 54.2 


57 


M 13.7 


6 














T 58.7 


68 


T 30.9 


5 










MAY 


zts* 


FORM R 


t YRS. 


UPPER A 


1 1 


French 


Z 




47 


1S4S 




R 80.0 


89 


I 9.5 


6 














V 77.2 


69 


I 17.1 


5 














G 71.3 


86 


M 4.0 


7 














T 78.9 


86 


T 30.5 


6 










MAY 


tts* 


RORM 0 


* YRS, 


UPPER A 


1 1 


Spmish 


t 


4i 


74 


1t44 




R 70.5 


67 


I 9.9 


6 














V 75.8 


82 


I 21.9 


6 














G 69.5 


79 


HI 4.9 


6 














T 74.2 


79 


T 36.7 


6 



*Or high-school equivalent of first 90. 



COLLEGE F 


HRS. 

PER 

GROUP WK, N 


TOTAL CO-OPERATIVE AURAL 

DATE HRS. MEAN RILE MEAN TENTH| 


GeiRMn 1 sits 


JUNE 50 PORM* LOWER A 1A 

R46.9 - I 3.8 5 

V 53.2 - 1 4.4 5 

G 51.2 - M 5.0 5 

T 50.2 - T 13.2 5 



♦N, 0, or P. 
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Has. 














1 


1 
















fCR 






TOTAL 


^Q*OfCOATlVC 




TOTAL 


CO-OFEaATIVE 




TOTAL 


CO«OFEaATlVE 


AUaAL 




COLLEGE G 


saoup 


«K. 


H 


OATC 


HOI. 


MEAN 


DATE 


Has. 


MEAN 




Has. 


MEAN 


WILE 


MEAN TENTH 










OCC* 


31 


FOOM n 


MAa . 


70 


FoaM a 




100 


form r 


1 Ya. 


LOWEa A 


la 




1 


4 


ai 


1144 




R 58.0 


1141 




R 79.2 


IMS 




R 84a 


99 


I 6,4 


7 














V 68.7 






V 78.2 






V 82.4 


99 


1 16,7 


8 














G 50.4 






G 60.1 






G 57.6 


65 


m 11.6 


7 














T 59.4 






T 75.1 






T 77. S 


99 


T 34.7 


8 




1 A. 




4 




31+ 


IR 59.9 




70+ 


R 75.5 




101+ 


R 81.5 


99 


I 6,1 


7 














V 65.2 






V 76,7 






V 80.4 


98 


1 17.6 


8 














G 56.4 






G 65.2 






G 60.4 


73 


m 6.8 


3 














T 60.9 






) T 74.8 






T 76. 5 


98 


T 30.5 


7 










ootc. 


31 


FOOM a 


MAO. 


.‘0 


FOaM a 


JUNE 


101 


FoaM a 


1 Ya. 


LOWEa A 


IS 




10 


4 


It 


1141 




R 57.3 


1141 




R 77.6 


Il4l 




R 84.0 


99 


I 8.9 


9 














V 64.8 






V 79.2 






V 84.1 


99 


I 18.9 


9 


F 












G 49.1 






G 55,3 






G 54.3 


49 


m 10.9 


5 


n 












T 57.7 






T 72.8 






T 76. 5 


98 


T 38.6 


8 


E 








JULY 






AUO. 






AUG, 




















tt 


31 


FoaM a 


7 


70 


FoaM a 


31 


101 


FoaM a 


1 Ya. 


LOWEa A 


IV 


N 


ICt 


It 


It 


1141 




R 55.8 


1141 




R 73.5 


1141 




R 82.5 


99 


I 6.7 


8 


c 












V 65.7 






V 76,1 






V 81.0 


99 


1 13.2 


7 


K 












G 53.3 






G 55.5 






G 58.2 


65 


m 15.0 


8 














T 59.2 






T 70.3 






T 76.5 


98 


T 34.9 


8 




1C . tl 


It 


II 




11^ 


R 59.2 




70+ 


R 79.0 




101+ 


R 85.0 


99 


I 7.3 


8 














V 68.9 






V 74.7 






V 80.5 


98 


1 13.3 


7 














G 55.0 






G 59.4 






G 59.3 


69 


m 13.4 


7 














T 62.2 






T 73.2 






T 77.6 


99 


T 34.1 


8 
















JUME 


70 


FoaM a 


AUG. 


101 


FoaM a 


1 Ya. 


LOWEa A 


ifl 




10* 


4 


II 








1141 




R 81.5 


1141 




R 81.0 


99 


1 10.2 


9 




















V 75.2 






V 81.1 


99 


1 16.9 


8 




















G 56.3 






G 56.9 


61 


n 17.3 


8 




















T 73.3 






T 78.4 


ff 


T 44.3 


10 










JULY 






AUG. 






AUO. 












Sn 








tf 


31 


FOaM 0 


14 


70 


FoaM 0 


ta 


101 


FOaM 0 


1 Ya. 


LOWEa A 


11 


PAn 




It 


to 


1141 




R 60.6 


1341 




R 69.6 


1141 




R 75.3 


99 


I 10.1 


9 


”le 












V 62.7 






V 68.1 






V 79.8 


99 


E 14.6 


9 














G 64.2 






G 65,1 






G 71.3 


98 


m 18.8 
















T 63.9 






T 69.5 






T 77.8 


99 


T 43.5 


9 



*Exciudii»f aubgroup la.li total meana ara: Go-oparative at 35 hra. , 58.9; at 70 hra. » 75.2; at 105 bra.) 77.5; 
aural) 36.1. 



IThia aubgroup had pravioua atudy of Franch. 

IThia aubgroup had no pravioua atudy of Franch ^ 
#niia group conaiatad of war vatarana. 

^Bomm of thia group had pravioua atudy Of Spaniah. 
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AN INVESTIGATION OF SECOND -LANGUAGE TEACHING 



HIGH 
SCHOOL A 


QROUP 


HRS. 

IPCR 

WK. 


N 


OATE 


rOTA» 

HRS. 


AURAL 

MEAN TENTH 


OATE 


TOTAL 

HRS. 


CO-OPERATIVE 
MEAN WILE 


AURAL 

MEAN TENTH 


















JUNE 


100 


FORM R^ 1 YR. 


LOWER A 


OR 




1 


4 


SS 










1S40 




R 49.4 


75 


I 


4.9 


7 






















V 47.9 


53 


1 


9.5 


6 






















G 48.5 


52 




5.7 


5 


F 




















T 48.1 


62 


T 


20.1 


6 


R 








OCT. 


1 10 


LOWER A 


OS 


JUNE 


200 


FORM 0 


Z YRS. 


LOWER S 




F 


i 


4 


17 


1 145 




I 4.9 


7 


1S4S 




R 67.6 


84 


I 


12.2 




JCi 












1 14.8 


8 






V 64.7 


70 


1 


17.6 


• 


N 












M 9.1 


7 






G 64.7 


74 


ni 


10.0 




C 












T 28.7 


9 






T 67.2 


77 


T 


39.8 


- 


H 








OCT. 


SIO 


UPPER A 


100 


JUNE 


SOO 


FORM 0 


S YRS. 


UPPER S 






1 


4 


f 


1S4S 




I 11.0 


9 


1f4S 




R 83.3 


93 


I 


7.2 
















1 14.4 


5 






V 76.9 


73 


I 


16.2 
















n 3.4 


6 






G 73.6 


78 


IS 


8.0 


- 














T 28.9 


7 






T 80.8 


86 


T 


31.4 


- 


So 
















JUNE 


200 


FORM 0 


2 YRS. 


LOWER A 


00 


Pa 

Am 


i 


4 


IS 










1S4« 




R 47.3 


24 


I 


3.8 


4 






















V 46.4 


21 


I 


8.1 


4 






















G 51.8 


42 


m 


12 5 


6 






















T 48.6 


30 


T 


24.3 


4 



^Elementary Form. 






i. 

I 

i 



!■ 

!; 

f 



.i 



I- 



o 
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“bm" 



G 

E 

R 

M 

A 



N 



^'1 



HRS. 
f KR 

GROUP WK. N 



X.IA • 34 



XU, I# *1 



X*1B • 33 



U 3 33 



U.l# • 



U.t# 10 



X»3A 



to 



X»2B 



1 1 



2A 



2A. 



TOTAL CO.OPCRAT! VC 
DATE HRS. MEAN %ILC 



AURAL 

MEAN TENTH 



FEB. 


1 to 


rORM Q 


1 YR, 






1t4f 




R 49.9 


27 










V 45.0 


11 










G 51.0 


43 










T 48.4 


23 










R 49.4 


24 










V 44.4 


10 










G 49.8 


39 










T 47.6 


22 






JUNE 


Ito 


rORM 0 


1 yr. 






IB4S 




R 50.3 


28 










V 48.6 


22 










G 53.0 


51 










T 50.5 


31 






JUNE 


BO 


FORM P 


1 YR. 


LOWER A 


It4< 




R 52.2 


34 










V ^2.5 


37 










G 54.3 


56 










T 53.2 


40 










R 55.3 


45 


I 


8.3 






V 55.1 


44 


1 


7.1 






G 62.3 


83 


M 


11.4 






T 58.1 


61 


T 


26.8 


JULY 












1I4S 








I 


9.6 










1 


8.1 










M 


14.1 










T 


31.8 


DEC. 


ISO 


FORM Q 


1 YR. 


LOWER A 


1I4S 




R 52.2 


34 


1 


9.1 






V 51.8 


32 


1 


8.6 






G 51.4 


44 


M 


11.8 






T 51.8 


36 


T 


29. F 



IB 



± 





DEC. 100 FORM Q 


1 YR. 


LOWER A 


IB 


• 4 


lt4S 




I 


7.9 


7 








1 


6.2 


4 








M 


8,7 


5 








T 


22.8 


6 


SB 


R 49.9 


27 


I 


6.9 


6 


V 47.7 


19 


1 


4.9 


4 




G 48.9 


35 


M 


5.9 


4 




1 T 48.6 


25 


T 


17.7 


5 



TOTAL CO-OPERATIVE 
DATE HRS. MEAN %ILC 



AURAL 

MEAN TENTH 



JUNE 

IS4C 



240 FORM N 2 YRS. 



R 62.9 


35 


V 56.5 


13 


G 56.0 


25 


T 59.2 


20 



AUG. 

1B4C 



ISO 



UPPER A n • It 



I 8.0 
1 17.4 
M 6*0 
T 31.4 



I 7.4 
I 17.3 
M 4.6 
T 29.3 



FEB. 

II4< 



240 FORM P t YRS. 

R 59.4 21 



V 62.8 
G 66.1 
T 64.1 



32 

64 

37 



JUNE 

1I4S 



210 FORM N 2 YRS. 



B 61.3 
V 60.2 
G 62.5 
T 62.4 



28 

22 

50 

32 



^K)iily this subgroup completed 240 hrs. 

#Aft«r 90 hr., it 3 per wh. , thi. aubgroup completed 180 hr., .t 14 pci wk. 

nrhi. aubgroup h.d the equivalent of the firat 90 hra. in high achool or in an earlier German courae. 
•Oniy this subgroup took the Co«oper stive test. 
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AN INVESTIGATION OF SECOND-LANGUAGE TEACHING 



COLLEGE 

1946>1947 


4 


HRS. 


























PEN 






TOTAL 


CO*OPENATOVE 


AUNAL 






TOTAL CQ*OPENATlVE 


AUNAL 


leeoup 


NN. 




DATE 


HNS. 


MEAN 


»ILE 


MEAN TENTH 


DATE 


HNS. MEAN 


ftlLE 


MEAN 


TENTH 


French 








PEO. 


110 


rORM R 


1 VR. 


LOMZR A 


ID 


JUNE 


140 FORM 0 


I VRS. 


UPPER A 


1 1 


1A 


• 


4H 


1047 




R 52. 3 


41 


I 8.0 


9 


1147 


R 69.1 


57 


I 12.0 


7 














V 59.1 


48 


1 15.1 


8 




V 73.5 


55 


1 17.8 


5 














G 56.4 


59 


11 9.6 


5 




G 63.9 


61 


M 3.2 


6 














T 56.5 


49 


T 32.8 


8 




T 70.6 


58 


T 33.0 


7 




1A. 1* 




• 






n 65.4 


85 


I 10.0 


9 




R 69.0 


57 


1 11.6 


7 














V 69.1 


84 


1 18.1 


8 




V 73.0 


53 


1 18.9 


5 














G 65.8 


89 


M 9.9 


5 




G 68.3 


77 


M 4.5 


7 














T 68.5 


89 


T 38.0 


8 




T 72.1 


63 


T 35.0 


7 


German 








! PEI. 


110 


rORM Q 


1 VR. 


LOWER A 


ID 


JUNE 


140 FORM P 


I VRS. 


UPPER A 


11*19t 


1A 


f 


ml 


1 1147 




R 49.9 


27 


I 6.9 


6 


1147 


R 58.7 


21 


I 6.5 


5 


1 












V 43.2 


8 


1 5.3 


4 




V 59.5 


21 


1 17.4 


6 














G 55.5 


61 


M 7.8 


5 




G 58.4 


33 


11 5.9 


5 














T 49.8 


29 


T 20.0 


5 




T 59.7 


22 


T 29.8 


8 




1A. 1* 




10 






R 54.3 


42 


I 8.5 


7 




R 61.7 


30 


I 8.7 


8 












V 52.1 


33 


1 7.1 


5 




V 65.0 


40 


I 19.4 


7 














G 64.0 


88 


M 8.9 


5 




G 62.2 


49 


M 7.2 


6 


1 












T 57.4 


57 


T 24.5 


7 




T 64.2 


57 


T 35.3 


8 


1 S^Mniah 








PEI. 


110 


FORM Q 


1 VR. 


LOWER A 


ID 


JUNE 


140 FORM F 


I VRS. 


UPPER A 


1 1 


1 A 


• 


70 


1147 




R 55.3 


56 


I 7.8 


8 


1147 


R 66.1 


51 


I 10.9 


7 


, 












V 52.8 


38 


1 12.7 


7 




V 60.7 


27 


I 25.3 


7 














G 50.6 


42 


m 14.6 


6 




G 64.0 


56 


m 3.8 


6 














T 53.7 


46 


T 35.1 


8 




T 65. 0 


44 


T 40.0 


7 




1 A. 1* 




0 






R 64.4 


87 


I 12.1 


9 




R 70.8 


70 


1 11.0 


7 














V 63.9 


81 


I 15.4 


9 




V 66.1 


46 


I 29.5 


9 














G 60.9 


82 


11 20.4 


9 




G 71.0 


82 


n 4.6 


7 














T 64.5 


85 


T 47.9 


10 




T 71.3 


69 


T 45.1 


8 










PEO. 


110 


ONV. 


TENTH 


LOVEN A 




JUNE 


140 INV. 


TENTH 


UPPER A 




ihiMian 


1A 


• 


tio 


1147 




R 5.2 


1 


I 5.2 


3 


1147 


R 20.5 


6 


I 6.6 


3 














V 5.2 


1 


1 11.1 


4 




V 16.6 


7 


I 17.5 


4 














G 12.9 


4 


m 14,9 


4 




G 21.1 


7 


M 5.4 


4 


, 












T 23.3 


1 


T 31.2 


4 




T 58.2 


6 


T 29.5 


3 


t 








JUNE 


110 


FORM R 


1 VR. 


LOWEN 1 


ID 


^otil R»«n icoroo mdc by these sub* 


1 IFlrench 




• 


41 


1047 


R 57.8 


62 


I 8.4 


7 


gx<QU]pa at placement in October » 


1946, 














V 60.9 
G 58.7 


56 

68 


1 13.0 
M 7.9 


S 

S 


French: Co-op. 
A 20.5 


R 61.1 


, Aural Upper 














T 60.8 


67 


I 29.4 


7 


German: Co-op. 


Q 47.2 


, Aural Upper 



Geinan 


is S IDS 




Sjpmiah 


IS S SI 



JUNE 

1947 



ISO 



JUNE 

U47 



ISO 



FORM Q 


1 VR. 


LOWER A 


IS 


A 17.0 


R 49.7 


27 


I 6.8 


6 


Sp.niah: 1 
A 26.5 


V 44.2 


10 


n 5.0 


4 


G 57.1 


67 


M 6.9 


4 




T 50.2 


30 


T .18.7 


5 




FORM Q 


1 VR. 


LOWEN 1 


ID 




R 53.2 


47 


I 10.0 


8 




V 50.3 


30 


1 9.8 


6 




G 45.3 


23 


JH 9.1 


2 




T 49.5 


30 


I 28.9 


5 





French 



SA • 



tA. 



if 



>0 



1i47 



t40 



FORM Q 


I VRS. 


UPPEN S 


1 1 


R 69.8 


60 


1 


7.9 


8 


V 75.3 


62 


1 


18.3 


9 


G 66.9 


72 


ISif 


7.3 


8 


T 72.9 


66 


T 


33.6 


9 


R 73.5 


73 


I 


9.6 


9 


V 77.8 


72 


1 


19.1 


9 


G 70.5 


84 


M 


6.4 


7 


T 76.5 


79 


T 


35.0 


9 
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HPS. 




I 














r 


'/COLLEGE H 








TOTAL C0«0PIEPATIV(C AUPAL 




TOTAL 


CO-OPERATIVE 


AURAL 


V 


1946*1947 


CROUIP 


WK. 


N 


DATE HRS. MEAN PILE MEAN TENTH 


DATE 


HRS. 


MEAN 


RILE 


MEAN 


TENTH 


f 


Genian 










rEi. 


t40 


FORM F 


t YRS. 


UFFCR A 


1 1- It 


f 


tA 


t 


iP 




1 P47 




R 62.3 


32 


I 5.5 


5 


















V 62.2 


29 


1 18.7 


7 


















G 61.6 


47 


m 6.4 


6 


















T 63.1 


34 


T 30.6 


8 






tA. if 




IP 








R 68.0 


54 


I 8.0 


8 


















V 69.2 


57 


1 28.1 


9 


i 
















G 71.3 


81 


M 7.8 


7 


















T 71.1 


66 


T 43.9 


9 




Speniih 








fTotpl RMpn scores msde by these sub* 


FES. 


t40 


FORM F 


t YRS. 


OFFER S 


1 1 




tA 


p 


101 


groups St plscement in C^tober, 1946| 
were: 

French: Co-op. R 67. 5| Aursl Upper 
A 30.6 


1P47 




R 71.2 


71 


I 11.7 


7 
















V 68.8 
G 70.5 


58 

79 


E 9.1 
H 5.4 


6 

4 


'! 

{ 




tA. l4 






Germsn: Co-op. Q62.0, Aursl UiH>sr A 






T 72.3 


72 


T 26.2 


7 


1 






t4 


31.5 






R 77 0 


88 


I 13.8 


9 












Spsnish: Co-op< Q6S.2. Aursl Upiper 






V 79.8 


91 


I 11.0 


7 












A 31.8 






G 76.5 


93 


11 5.8 


5 


















T 80.3 


93 


T 30.6 


8 




French 










JUNE 


t40 


FORM 0 


t YRS. 


OFFER A 


11 




ti 


$ 


IP 




1P47 




R 77.6 


84 


I 13.7 


8 


















V 79.1 


76 


I 20.8 


7 


















G 71.0 


86 


M 5.0 


8 


















T 78.7 


85 


T 39.5 


8 






tp. 11 




P 


- 






R 82.6 


93 


I 15.1 


8 


















V 80.9 


82 


1 23.4 


8 


i' 


1 














G 72.1 


89 


11 5.9 


8 


1; 














T 81.6 


90 


T 44.4 


9 




j 

Genmn 










JUNE 


t40 


FORM F 


t YRS. 


OFFER A 


1 1- It 




» 


• 


t4 




1347 




R 62.7 


34 


I 6.3 


5 


















V 63.5 


34 


I 16.3 


6 


1 


: 














G 60.8 


44 


M 6. 0 


5 


1 
















T 63.5 


35 


T 28.6 


7 


jl 




to. 1# 




11 








R 63.9 


38 


I 6.6 


7 


} 
















V 62.5 


30 


1 18.4 


7 


















G 62.1 


48 


H 6.8 


6 




i ^ 














T 64.2 


38 


T 31.8 


8 












iTotsl nesn scores msde by these sub- 


JUNE 


t40 


FORM F 


t YRS. 


UPPER A 


1 1 




S^ish 


ti 


p 


10 


(proups St plscement in Februsry, 1947 , 


1P47 




R 70.8 


70 


I 11.7 


7 












ire re: 

French: Co-op. Q 73.9, Aursl Upper 
R 16 . 0 

Germsn: Co-op. Q 49.8, Aursl Upper 






V 65.1 
G 69.2 


42 

76 


1 24.7 
m 2.4 


7 

3 




i 












T 70.4 


67 


T 38.8 


7 




j 


tp. 1# 




7 


A 17.6 






R 72.6 


76 


1 12.1 


7 












Spsnish: Co-op. P 62.4, Aursl Upper 






V 67.4 


52 


I 23.7 


6 




i( 








B 16.0 






G 72.1 


84 


m 2. 3 


3 


















T 73.1 


76 


T 38.1 


7 




! Frendi . 

[ Gonventional 










FES. 


IPO 


FORM 0 


2 YRS. 


OFFER S 


1 1 


i 




3 


ts 




1P47 




R 62.1 
V 69.2 


31 

37 


I 6.4 
I 9.3 


6 

4 


















G 62.4 


54 


M 3.7 


5 


















T 66.2 


40 


T 19.4 


5 




Genmn , 
Gonventuxul 






4S 




FES. 


IPO 


FORM F 


t YRS. 


UPPER A 


1 1- It 






3 




1P47 




R 59.8 
V 61.4 


25 

25 


I 5.3 
1 12.9 


4 

5 


















G 55.3 


23 


M 6.2 


5 


















T 59.7 


23 


T 24.4 


6 




&«iish. 

Gcnventional 










FEP. 


IPO 


FORM F 


2 YRS. 


OFFER S 


II 






3 


43 




1P47 




R 70.2 
V 70.6 


67 

66 


I 10.2 
I 7.5 


5 

6 


















G 70.7 


81 


n 5. 3 


4 




1 , . 






1 








T 72.5 


72 


T 23.0 


6 




1 
























j 




















[ 
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n 




^ 1 


ICOLLEGE J 

1 French 


HRS. 

PER 

WX. H 


DATE 


TOTAL 

HRS. 


C0*0PERAT1 VE 
MEAN 


AURAL 

MEAN TENTH 


date 


TOTAL CO. OPERATIVE 
HRS. MEAN WILE 


OATE 


TOTAL co«operat:ve 

HRS. MEAN WILE 


AURAL 1 

MEAN TENTH 


X* 1A 


10 r 




MAR. 

1S4S 


• 0 


FORM 0 

B 42. 1 
V 57.8 
G 47.9 
T 47,2 


1 YR. 

11 

42 

25 

_17_ 


JUNE 

194S 


ISO 


FORM 0 

B 44.5 
V 63,2 
G 52.5 
T 53.5 


1 YR. 

16 

65 

42 

37 


LOWER A 

I 6.1 
S 12.2 
m 14.4 
T 32.7 


IB 

7 1 
5 

8 
8 


X-IA.I^ 


• 4 


DEC. 

1S4S 


ISO 


FORM R 

B 52.4 
V 60.4 
G 57.3 
T 57.2 


UPPER • 

I 2.0 
I 11.1 
m 7.3 
T 20.4 


1 1 

2 

5 

8 

5 


MAR. 

1S4S 


B 36 8 

V 58.3 
G 49.3 
T 48.1 

StO FORM 0 

B 55.6 

V 69.0 
G 56.7 
T 61.4 


*4 " 
44 

29 

19 


JUNE 

1S4S 


SSO 


B 41.6 

V 63.8 
G 55.0 
T 53.8 

FORM R 

B 65.8 

V 66.1 
G 61.6 
T 66.0 


10 I 6.9 
67 n 12.9 
S3 n 15.3 

38 T 35.1 

1 YRS. UPPER A 

45 I 11.3 
25 I 18.2 
SO m 3.9 

39 T 33.4 


8 

7 

8 
8 

1 1 
6 
5 
7 
7 






JAN. 


ss 


FORM 0 








MAR. 


70 


FORM 0 




JUNE 


10S 


FORM 0 


1 YR. 








1 A 


4 41 


IMS 




B 38.9 








1S4S 




B 48.1 




1S4S 




B 56.6 


58 
















V 58.0 












V 62.9 








V 69.5 


84 
















G 50.9 












G 58.5 








G 62.8 


81 








- 








T 49.3 












T 56.8 








T 63.6 


75 
















B 37.6 












“b 48.0 








B 59.4 


67 
















V 56 . 6 












V 62.1 








V 68.1 


81 
















G 50.6 












G 59.4 








G 65.6 


88 
















T 48.1 












T 56,6 








T 65.1 


80 








1 A 


17 « 


DEC. 


140 


FORM R 


UPPER B 


1 1 


MAR. 


17S 


FORM 0 




JUNE 


tio 


FORM R 


t YRS, 


. UPPER A 


11 


1 A. I" 




1 S4S 




B 71.2 


I 


4.6 


5 


1S4S 




B 66.5 


_ 


tS4t 




B 79.1 


87 


I 


10.4 


6 










V 65. 1 


I 


8.6 


4 






V 74.0 


. 






V 73.2 


54 


I 


18.5 


s 










G 64.1 


TUf 


4.2 


5 






G 68.9 








G 67.7 


75 


m 


3.4 


6 











T 68.9 


T 


17.4 


4 






T 72.0 


- 






T 75.3 


74 


T 


32.3 


6 












1 














JUNE 


ISO 


FORM R 


1 YR. 


LOWER A 


IB 


X* li 


7 








1 














1S4« 




B 29.0 


0 


I 


4.1 


5 






























V 53.4 


26 


s 


11.5 


5 






























G 46.1 


19 


m 


4.8 


2 






























T 42.2 


7 


T 


20.4 


4 




10, 


DEC. 


140 


FORM Q 


. UPPER b4 


1 1 


MAR. 


SOO 


FORM 0 




JUNE 


SSO 


FORM 0 


t YRS. 


UPPER t 


1 1 






1 S4S 




B 48.3 


I 


9.S 


9 


1 S47 




B 53.7 




1S47 




B 70.5 


63 


I 


11.9 


7 










V 65. 5 ^ 


1 Q 


16.8 


8 






V 69.3 


- 






V 75.6 


63 


I 


21.6 


8 










G 54.3 1 


1 J* 


6 . 4 


7 






G 55.9 


• 






G 67.0 


73 


M 


5.1 


8 










T 56.6 1 


If 


32.7 


9 






T 60.5 


- 






T 73.2 


67 


T 


38.6 


8 






OEC. 


SS 


FORM R j 


1 LOWER b4 




MAR. 


7o 


FORM 0 




JUNE 


los 


FORM R 


1 YR. 


LOWER A 


IB 


1 • 


4 4S 


1 S4S 




B 37.0 1 


1 I 


6.0 


- 


1S4S 




B 45.0 


. 


tS4t 




B 57.7 


61 


I 


5.8 


7 










V 51.6 


1 s. 


11.4 


- 






V 60.2 


. 






V 61.9 


60 


I 


13.6 


7 










G 54.8 j 




7.7 


- 






G 38.2 


- 






G 58,8 


64 


TBT 


8.9 


4 










T47.7 1 


1 T 


25.1 


- 






T 54.9 


- 






T 60.4 


65 


T 


28.3 


7 










1 


1 LOWER b4 


IB 


MAR. 


1 to 


FORM 0 


1 YR. 


JUNE 


ISO 


FORM 0 


1 YR. 


LOWER A 


IB 


X- 1C . 1 


7 14 






1 


; I 


6.7 


6 


1S47 




B 36.1 


4 


1S47 




B 50.2 


33 


I 


6.7 


8 












1 


16.4 


7 






V 63.6 


66 






V 68.6 


83 


1 


16.4 


8 












IBT 


6 . 5 


4 






G 47.4 


23 






G 57,4 


63 


n 


14.0 


8 / 












T 


29.6 


7 






T 48.9 


25 






T 59.6 


61 


T 


37.1 


8 { 


X*IC,t 


7 14 








I 


9.9 


8 






B 47.5 


24 






B 56.9 


59 


I 


7.8 


9 4 










1 


I 


16. 1 


7 






V 62.8 


63 






V 68.2 


82 


I 


17.7 


8 L 










1 


HIT 


8.1 


5 






G 58.4 


67 






G 66.8 


91 


M 


13.9 


8 










1 


T 


34.1 


8 






T 56.7 


50 


* 




T 65.4 


81 


T 


39.4 


® 1 


















MAR. 


H.S. 


FORM 0 1 


! YRS. 


JUNE 


H.S. 


FORM 0 ] 


K YRS. 








X - I Af 


t ^ 














1S4S 


♦70 


B 66.2 


46 


1S4S 


♦l40 


B 73.3 


73 




























V 76.1 


65 






V 78.1 


73 








,, 




















G 71.2 


86 






G 71.5 


87 




























T 73.4 


67 






T 76.3 


78 










1 1 « 


OEC, 


H.S. 


FORM R 


UPPER i 


It 


MAR. 


H.S. 


FORM 0 




JUNE 


H.S. 


FORM R S YRS. 


UPPER A 


It 






1 S4S 


♦ no 


B 86.4 


I 


10.0 


6 


1 S4t 


♦tss 


B 78.0 




1S4S 


♦soo 


B 86.8 


88 


I 


17.5 


7 










V 78.8 


n 17.0 


5 






V 83.0 


• 






V 81.4 


50 


I 


29.3 


7 










G 67. 5 




9. a 


7 






G 71.4 


- 






G 74.0 


83 


Try 


6.7 


6 


> ' 








T 82. 5 


T 


36.0 


7 






T 80.1 


- 






T 83.9 


78 


T 


53.5 


8 
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boLLEGE J 

^ French 


Ihrs. 

Rwk. 


N 


DATE 


TOTAL CO-OPERATIVE AURAL 

HRS. MEAN MEAN TENTH 


DATE 


TOTAL 
HRS . 


CO*OPERATIVE 
MEAN %ILE 


DATE 


total 

HRS . 


CO‘ OPERAT 1 VE 
MEAN %ILE 


AURAL 

MEAN TENTH 


1 XA 


4 




JAN. 

t»45 


H.S. 
+ S5 


FORM 0 

T1 60.5 
V 72.1 
G 62.7 
T 66.7 








MAR. 
1 945 


H.S. 
+ 70 


FORM 0 

R 66.5 
V 74.3 
G 67.3 
T 71.4 


- 


JUNE 
1 94S 


H.S. 
♦l 09 


FORM 0 

R 74.1 
V 79.4 
G 68.8 
T 76.5 


2 YRS. 

75 

77 

79 

79 












DEC. 


H.S. 


FORM R 


UPPER B 


1 2 


MAR . 


H.S. 


FORM 0 




JUNE 


H.S. 


FORM R 


3 YRS . 


UPPER A 


1 2 


1 


S 


ft 


IS45 


+ XB 


R 88*0 


T 


7.7 


4 


1944 


+ 55 


H 74.7 




1944 


+ 80 


R 91.0 


94 


I 13.2 


4 












V 80.6 


c 


15.9 


5 






V 80.5 


- 






V 82.1 


52 


0 21.1 


4 












G 71.8 


in 


7.1 


5 






G 69.5 


- 






G 72.1 


77 


m 4.9 


5 












T 83.4 


T 


30.7 


5 






T 77.5 


- 






T 84.9 


81 


T 39.2 


5 








DEC. 


H.S. 


FORM R 


UPPER B 


1 1 


MAR . 


H.S. 


FORM 0 




JUNE 


H.S. 


FORM R 


2 YRS , 


UPPER A 


1 1 


1 


7 


B 


(§49 


♦so 


R 77.4 


I 


6.1 


6 


1944 


♦l 20 


R 71.4 




1 946 


♦ 180 


R 88.2. 


98 


1 13.1 


7 












V 74.8 


n 


16.5 


8 






V 79.3 


- 






V 77.1 


69 


n 20.8 


7 


fi! 










G 72.5 


ns 


6.1 


7 






G 71.4 


- 






G 69.8 


81 


m 5.2 


8 


I 

ft 










T 77.6 


T 


28.7 


8 






T 76.3 








T 81.1 


90 


T 39. 1 




1 






DEC. 


H.S. 


FORM R 


upper b 


1 1 


MAR . 


H.S. 


FORM 0 




JUNE 


H.S. 


FORM R 


2 YRS . 


UPPER A 


11 


1 xa 


4 


fS 


1945 


♦S9 


R 71.5 


] 


5.0 


5 


1944 


+ 70 


R 65.7 


- 


1 944 


♦ 105 


R 78.6 


86 


I 10.4 


6 


1 










V 69.0 


n 


8.4 


4 






V 74.8 


- 






V 75.3 


63 


n 17.6 


5 


1 










G 64.8 


in 


4.3 


5 






G 66.7 


- 






G 68.7 


78 


m 3.6 


7 


1 










T 70.3 


T 


17.7 


5 






T 71.0 


- 






T 76.7 


79 


T 31.6 


6 


h 












1 UPPER b4 


n 


MAR . 


H.S. 


FORM 0 


2 YRS. 


JUNE 


H.S. 


FORM Q 


2 YRS. 


UPPER A 


1 1 


1 x«xc 


7 


s 








1 I 


10.7 


9 


1 947 


+ 120 


R 63.7 


36 


1947 


+ 1 6.0 


R 75.8 


80 


1 14,2 


8 














n 


20.0 


9 






V 73.2 


54 






V 78.8 


. 76 


n 16.7 


5 














1 nr 


9.0 


9 






G 65.7 


67 






G 68.7 


80 


in 6.7 


9 
















39.7 


9 






T 68.7 


50 






T 77.0 


80 


T 37.5 


8 



*This subgroup continued through two years. 



flliis sural tasting took place in March. 

ifln the second year, hours per week were 8 in first quarter, 5 in second and third quarters. 
•8offle. of these students were taking another advanced French course concurrently. 
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COLLEGE j| 


HRS. 

PER 








TOTAL 


CO-OPERATIVE AURAL 






total 


CO>OPERATiVE 




TOTAL 


CO* OPERATIVE 


AURAL 


h 

' 


Spanish | 


NK. 


N 




DATE 


HRS. 


MEAN 


MEAN TENTH 


OATL 


HRS. 


MEAN 


%ILE 


DATE 


HRS. 


MEAN 


«ILE 


MEAN TENT^ 




















MAR. 


50 


FORM 0 


1 YR. 


JUNE 


ISO 


FORM 0 


1 YR, 


LONER A 


IS 


X-1A.1 


to 




1 












1545 




R 45.9 


20 


1S4S 




R 56.4 


61 


I 8.5 


8 1 
























V 45,1 


14 






V 46.7 


18 


n 12.1 


8 1 
























G 35.1 


3 






G 38.4 


7 


m 12.0 


5 
























T 41.1 


8 






T 47.8 


24 


T 32.6 


IJ 
























n 54.4 


52 






R 60.6 


76 




1 
























V 52.4 


37 






V 54.8 


47 




























G 36.2 


4 






G 40.7 


11 




























T 47.4 


23 






T 52.3 


41 










• < 




DEC. 


250 


FORM 0 


UPPER ■ 


1 1 


MAR. 


320 


FORM Q 




JUNE 


3tO 


FORM 0 


2 YRS. 


UPPER A 


1 1 


X. 1 A.f* 








1S45 




R 64.0 


I 13.1 


8 


154C 




R 65.6 




1 C4C 




R 70.6 


69 


I 15.2 


9 














V 56.6 


n 13.0 


8 






V 62.3 


.. 






V 65.9 


46 


1 26.1 


7 














G 49.9 


in 4.4 


3 






G 60.1 








G 61.6 


46 


m 5.4 


6 














T 57.8 


T 30.5 


7 






T 68.6 


- 






T 67.6 


55 


T 46.7 


_Lj 










JAN. 


35 


FORM 0 






MAR. 


70 


FORM b 




JUNE 


lOS 


FORM 0 


1 YR. 




5 


1 A 


4 


• 4 


tt4S 




R 45.5 






1545 




R 56.2 


. 


lt4S 




R 62.7 


82 


















V 48.3 










V 55.5 


- 






V 62.0 


75 


















G 43.3 










G 51.5 


- 






G 56.3 


66 


















T 45.2 










T 54.6 


- 






T 61.4 


77 






1 A. 












R 46.5 










R 55.7 








R 62.8 


82 
















V 46.3 










V 54.8 








V 61,8 


74 




’ I 














G 43.0 










G 50.7 








G 56.2 


66 


















T 44.4 










T 53.8 


- 






T 61.2 


76 










SO * 




DEC . 


140 


FORM 0 


UPPER ■ 


1 \ 


MAR. 


175 


FORM Q 




JUNE 


210 


FORM 0 


2 YRS. 


UPPER A 


1 1 










1S45 




R 66.6 


I 7.9 
1 7.4 


4 


154S 




R 68.9 


- 


I34C 




R 72.2 


75 


I 9.2 


5 














V 67.8 


5 






V 70.9 








V 73.9 


77 


1 24.3 


6 














G 56.9 


M 5.8 


5 






G 66.5 


- 






G 68.9 


75 


m 4.7 


S 














T 65.3 


T 21.1 


5 






T 70.7 


- 






T 73.8 


78 


T 38,2 


6 










DEC . 


CO 


FORM 0 


1 LONER 


IS 


MAR. 


120 


FORM Q 


1 YR. 


JUNE 


ICO 


FORM 0 


1 YR. 


LONER A 


IS 


X* IS 


7 






1f4t 




R 50.6 


|I 10.9 


8 


I54C 




R 55.8 


58 


lt4C 




R 59.8 


73 


I 8.4 


8 














V 47.8 


'n 11.0 


6 






V 52.5 


37 






V 53.7 


41 


n 12.4 


6 














G 38.0 


1 m 13.8 


5 






G 51.2 


45 






G 56.3 


66 


HI 14.5 


6 1 














T 45.0 


|t 35.7 
upfJr "• 


7 






T 53.7 


46 






T 57.4 


62 


T 35.3 


7 






25 < 




DEC. 


24 0 


FORM 0 


7i 


MAR. 


300 


FORM Q 




JUNE 


SCO 


FORM 0 


2 YRs. 


UPPER A 


1 1* ! 










I»4< 




R 64.3 


I 11.7 


8 


1547 




R 66.4 




1347 




R 68.9 


63 


I 11.2 


6 1 














V 56.7 


n 8.8 


6 






V 61.2 


- 






V 66.9 


50 


H 23.5 


6 ! 














G 63.7 


HI 7.7 


7 






G 64.9 


. 






G 67.3 


64 


m 6.2 


7 i 














T 62.8 


T 28.2 


7 






T 65.6 


- 






T 69.6 


63 


T 40.9 


7 1 










OEC^ 


35 


FORM 0 






MAR . 


70 


FORM 0 




JUNE 


105 


FORM 0 


1 YR. 


LONER A 


1 


IS 


4 


• • 


1545 




R 47.4 






154C 




R 59.7 


- 


134C 




R 64.8 


88 


I 6.0 


6 i 














V 48.0 










V 57.1 


_ 






V 61.1 


72 


1 12.0 


6 














G 46.0 










G 58.7 


_ 






G 62.6 


86 


HI 13.8 


6 














T 47- 0 










T 59.5 


- 






T 64.2 


85 


T 31.8 


7 
















1 LONER R^ 


11 


MAR . 


120 


FORM Q 


1 YR. 


JUNE 


ICO 


FORM 0 


1 YR . 


LONER A 


IB 


X.|t 


7 


27 








II 11.9 
H 14.5 


9 


1547 




R 56.7 


62 


1147 




R 63.3 


84 


I 8.2 


8 
















8 






V 53.2 


40 






V 54.1 


43 


E 12.0 


6 
















M 14.7 
jl 41.1 


5 






G 49.8 


39 






G 56.1 


6& 


m 15.0 


6 
















8 






T 53.7 


46 






T 58.9 


68 


T 35.2 






















MAR . 


H.S. 


FORM 0 


2 YRS. 


JUNE 


H.S. 


FORM 0 


2 YRS. 


UPPCK A 


11 ! 


X* 2A 


• 


2i 












1545 


+70 


R 70.2 


68 


lt4S 


♦|40 


R 74.5 


82 


I 15.8 


9 V‘ 
























V 65.8 


15 






V 72.0 


70 


H 31.3 


9 ) 
























G 57.3 


2y 






G 60.4 


42 


n 6.4 


7 ^ 
























T 65.7 


46 






T 70.8 


68 


T 53.5 




X-2A.1*# 






















R 71.2 


71 






R 76.2 


87 


I 17.2 


9 






















V 66.2 


47 






V 76.1 


82 


H 31.1 


9 
























G 59.7 


38 






G 64.1 


56 


M 7.2 


8 
























T 67.1 


53 






T 74.0 


79 


T 55.5 


9 






IS ^ 




DEC. 


H.S. 


FORM 0 


UPPER ■ 


12 


MAR . 


H.S. 


FORM Q 




JUNE 


H.S. 


FORM 0 


3 YHS. 


UPPER A 


12 










1S45 


+ 210 


R 84.0 


I 14.3 


5 


1545 


+255 


R 73.6 




1§4C 


♦soo 


R 80.3 


76 


I 19.2 


9 














V 78.3 


H 13.7 


5 






V 78.0 


. 






V 82.4 


75 


1 32.3 


9 














G 64.6 


m 8.2 


4 






G 76.4 








G 73.8 


76 


m 7.7 


9 








a , 






T 76.7 


T 36.2 


5 






T 78.0 


- 






T 81.5 


79 


T 59.2 


9 


' 

1 



\ 



ERIC 
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I 



•OPERATIVE 




AURAL 






TOTAL 


CO< OPERATIVE 




TOTAL 


CO-OPERATIVE 




AURAL 


MEAN 


MEAN TENTN 


OATE 


NRS. 


MEAN 


ftl LE 


OATE 


NRS. 


MEAN 


ftILE 


MEAN 


TENTN 


FORM 0 








MAR. 


N.S. 


FORM 0 




JUNE 


N.S. 


FORM 0 


I YRS. 








R 65.6 








1S4S 


♦70 


R 70.3 




IS45 


♦lOS 


R 78.4 


91 








V 66.9 












V 71.0 








V 80.0 


91 








G 58.0 












G 61.2 








G 65.4 


62 








T 63.7 _ 












J 69.0 








J 76 JL 










R 66.1 






) 


f 




1r 73.8 








1r 78.8 


- 

" 91 








V 68.9 












V 72.5 








V 81.7 


93 








G 60.6 












G 64.0 








G 65.0 


60 








T 66.2 












T 71.7 








T 77.6 


87 








FORM 0 


UPPER^" » 


♦ 

It 


MAR. 


N.S. 


FORM Q 




JUNE 


N.S. 


FORM.O 


3\VRS. 


UPPER A 


IS 


R 74.6 


I 


12.9 


4 


IS4S 


♦ tso 


R 77.2 




tS4S 


♦iss 


R 78.6 


70 


I 


15.2 


7 


V 81.0 


1 


13.3 


4 






V 85.5 


. 






V 85.3 


83 


n 


29.2 


7 


G 64.2 


m 


6.8 


4 






G 72.8 


. 






G 74.2 


78 


m 


5.5 


7 


T 76.3 


T 


33.0 


4 






T 81.2 


- 






T 82.2 


80 


T 


49.9 


8 


FORM 0 


UPPER ■ 


11 


MAR. 


N.S. 


FORM Q 




JUNE 


N.S. 


FORM 0 


3 YRS. 


UPPER A 


1 s 


R 71.8 


I 


9.4 


2 


IS4S 


♦55 


R 74.7 




IS4S 


♦so 


R 73.6 


50 


I 


12.1 


5 


V 73.8 


n 


11.8 


4 






V 77.5 


- 






V 79.7 


65 


n 


26.5 


6 


G 56.6 


m 


7.2 


4 






G 64.4 


. 






G 66.8 


50 


M 


4.5 


5 


T 69.1 


T 


28.4 


3 






T 74.4 


- 






T 75.5 


57 


T 


43.1 


6 


FORM 0 


UPPER S 


1 1 


MAR. 


N.S. 


FORM Q 




JUNE 


N.S. 


FORM 0 


S YRS. 


UPPER A 


1 1 


R 68.2 


1 


10.8 


5 


IS4S 


♦no 


R 71.2 


. 


IS4S 


♦lao 


F. 72.2 


75 


I 


15.2 


9 


V 67.6 


1 


9.8 


7 






V 70.4 


. 






V 73.4 


74 


n 


27.7 


8 


G 61.0 


m 


8.2 


7 






G 71.6 


. 






G 70.9 


81 


m 


4.1 


5 


T 67.2 


T 


28.8 


7 






T 73.1 


- 






T 74.2 


80 


T 


47.0 


8 


FORM 0 


UPPER ■ 


1 1 


MAR. 


N.S. 


FORM Q 




JUNE 


N.S. 


FORM 0 


2 YRS. 


UPPER A 


1 1 


R 64.2 


1 


6.5 


3 


tt4S 


♦70 


R 68.8 


_ 


1 S4S 


♦1 OS 


R 71.3 


71 


I 


10.0 


6 


V 66.5 


n 


6.0 


5 






V 70.3 


. 






V 74.0 


77 


I 


23.3 


6 


G 58.0 


m 


5.9 


5 






G 65.9 


. 






G 68.1 


72 


M 


4.2 


5 


T 63.7 


T 


18.4 


3 






T 70.2 


- 






T 73.2 


76 


T 


37.5 


6 


FORM 0 


UPPER ■ 


1 1 


MAR. 


N.S. 


FORM Q 




JUNE 


N.S. 


FORM 0 


2 YRS. 


UPPER A 


1 1 


R 70.8 


I 


12.0 


Q 


tS47 


♦t to 


R 72.4 


_ 


tS47 


♦tso 


R 74.1 


80 


I 


15.3 


9 


V 67.0 


1 


11.3 


7 






V 73.0 


. 






V 73.5 


75 




26.1 


7 


G 67.6 


m 


7.7 


7 






G 72.5 


. 






G 69.8 


78 


n 


6.9 


8 


T 70.4 


T 


31.0 


7 






T 74.8 


- 






T 74.6 


80 


T 


48.3 


9 



COLLEGE 

Spaniah 



NAS . 
PER 



lA. I* 



DATE HRS. 



JAH. 

lt4S 



N.S. 

♦35 



OEC. N.S. 
IS4S*^I33 



OEC. 

It45 



N.S. 

♦ift 



X- 



27 



OEC. 

IS45 



N.S. 

♦so 



OEC. 

IS4S 



N.S. 

♦35 



3» 



OEC . 

IS4S 



N.S. 

♦so 



*Thia subgroup continued through two years. 

#thia aural testing took place in March. 

Ilh the second year, hours per week were 8 in first quarter, 5 in second and third quarters. 

iOily testing in second year was Aural Upper B at H.S.*^ 208 hrs. in Dec. 1946. Total mean: 40.3 (6th tenth). 
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AN 


INVESTIGATION 


OF 


SECOND -LANGUAGE 


TEACHING 




COLLEGE J 

Gtmtn 


HRS. 

PER 

WK. N 


OATE 


TOTAL 

HRS. 


CO-OPERATIVE AURAL 

MEAN MEAN TENTH 


oate 


total co-operative 

HRS . MEAN 


oate 


total 

HRS . 


CO-OPERATIVE 
MEAN NILE 


■ A 

AURAL 

MEAN TENTH 












1 LOWER A* 


1 ■ 


MAR. 


120 


FORM 0 


JUNE 


ISO 


FORM 0 


1 YR. 


LOWER A 


IS 


K-l 


7 IS 








I 


6.8 


6 


1t4S 




R 49.5 


IS4S 




R 54.2 


42 


I 9.9 


8 


‘ 










I 


5.6 


4 






V.51.1 






V 55.5 


46 


H 7.5 


6 












1 n 


8.8 


5 






G 49.6 






G 54.1 


55 


m 11.4 


6 












IT 


2X.2 


6 






T 50.3 






T 55.0 


48 


T 28.8 


7 












1 LOWER A^ 


lA 


MAR. 


70 


FORM 0 


Jl^NE 


lOS 


FORM Q 


1 YR. 


LOWER A 


IS 


1 


4 »S 








, I 


4.8 


6 


lt4S 




R 53.4 


lt4S 




R 57.3 


54 


I 6.8 


6 












s 


4.9 


6 






V 57.4 






V 60.2 


66 


H 5.6 


4 












m 


7.3 


6 






G 47.3 






G 49.7 


38 


M 8.8 


5 


‘ 










It 


X7.0 


6 






T 52.9 






T 56.1 


52 


T 21.2 


6 






OEC. 


H.S. 


PORM Q 


UPPER A 


II- 11 


MAR. 


H.S. 


FORM 0 


JUNE 


H.S. 


FORM Q 


a YRS. 


, UPPER A 


11- la 


X-t 


7 t 


1S4S 


♦so 


n 59.6 


1 


5.6 


5 


lt4S 


♦ lao 


R 62.9 


IS4S 


♦ ito 


R 65.7 


44 


I 13.7 


9 


■ ~ 








V 58.7 


1 


20.6 


8 






V 65.8 






V 65.8 


43 


I 29.6 


9 










G 59.x 


inT 


7.0 


6 






G 54.8 






G 62.4 


50 


ID 11.4 


9 










T 59.9 


T 


33.2 


8 






T 62.2 






T 66.0 


45 


T 54.74 


9 / 






OEC. 


H.S. 


PORM Q 


UPPER A 


n.ii 


MAR. 


H.S. 


FORM 0 


JUNE 


H.S. 


FORM Q 


a YRS, 


. UPPER A 


1 1 - la j 


t 


4 14 


1t4S 


♦as 


R 58.x 


1 


4.5 


4 


1S4S 


♦70 


R 60.8 


IS4S 


♦lOS 


R 67.0 


50 


I 5.3 


5 ! 










V 58.0 


n 


X3.4 


5 






V 62.1 






V 64.6 


39 


S 15.8 












G 55.9 


TUT 


5.3 


5 






G 53.1 






G 60.6 


43 


HD 6.3 












T 58.0 


T 


23.2 


5 






T 59.4 






T 65.5 


43 


T 27.4 


7 1 






OEC. 


H.S. 


PORM Q 


UPPER A 


n- 1 a 


MAR. 


H.S. 


FORM 0 


JUNE 


H.S. 


FORM Q 


a YRS, 


. UPPER A 


11. 1 a 


a 


a t 


1»4S 


♦at 


R 73.3 


1 


7.2 


7 


IS4S 


♦ss 


R H.7 


IS4S 


♦to 


R 74.0 


51 


I 9.9 


8 










V 7X.0 


1 


X5.8 


6 






V 3.7 






V 71.8 


32 


1 22.1 


8 










G 66.8 


n 


5.2 


5 






G o2.3 






G 69.4 


61 


m 9.3 


8 










T 72.3 


T . 


28.2 


7 






T 72.2 






T 73.8 


48 


T 41.3 


8 


*Hiis aural 


tea ting took place 


in March. 


























Uliia group had already taken Aural Upper A in 


Itbrch 


as well aa 


1 in December. Total mean in March: 48.4 '9th tenth). 
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n*— 

COLLEGE B 

1 Rxpii^riiDtntul 


GROUP 


HRS. 

PER 

HR. 


N 


DmTC 


TOTAL 

HRS. 


CO*OPERATIVE 
MEAN NILE 


AURAL 

MEAN TENTH 


TOTAL 
OATE HRS. 


CO-OPERATIVE 
MEAN RILE 


AURAL 

MEAN TENTH 










pKi. 


ISO 


FORM R 


1 VR. 


LOWER i 


t 












French 


1 A 


f 


I 


IS4t 




H 52.2 


40 


1 10.6 


9 
























V 51.1 


47 


S 17.8 


8 
























G 57.4 


63 


ID 13.6 


7 
























T 56.1 


50 


T 42.0 


9 




















PER. 


ISO 


FORM 0 


1 VR. 


LOWER • 


It 












Spmish 


1A 


t 


t 


is4« 




R 65.: 


88 


1 13.3 


9 
























V 65.3 


84 


1 15.0 


8 
























G 65.0 


91 


m 20.5 


8 
























T 66. C 


90 


T 48.8 


9 




















MAR. 


Itc 


FORM R 


1 VR. 


LOWER A 


t . 












French 




111 


t 


7 


IS47 




R $0.1 


32 


I 7.9 


7 












' 












V 62.1 


60 


1 11.1 


3 
























G 59.4 


70 


ID 13.9 


6 
























T 57.6 


53 


T 32.9 


6 




















MAR. 


Its 


FORM 0 


1 VR. 


LOWER A 


It 












Spnnieh 


It 


f 


It 


IS47 




R 64.4 


87 


1 13.1 


9 
























V 63.5 


79 


0 16.3 


9 
























G 69.1 


96 


m 15.0 


6 
























T 67.3 


91 


T 44.4 


9 




















OCT. 


HI. 


*FORM R 


1 VR. 


UPPER A 


II 


APR. H.S. 


FORM R 


S VRS. 


UPPER . 


It 


French 


lA 


t 


S 


It4l 


♦so 


R 63.0 


79 


1 8.0 


5 


It4t ♦tto 


R 71.0 


35 


I 5.7 


2 














V 69.7 


85 


I 15.0 


4 




V 73.0 


18 


I 12.0 


4 














G 68.3 


93 


m s.o 


8 




G 74.7 


85 


n 5.7 


4 














T 61.7 


89 


T 28.0 


5 




T 75.0 


44 


T 23.3 


3 










NOV. 


H.S. 


FORM Q 


1 VR. 


UPPER A 


II 


APR. H.S. 


FORM 0 


S VRS. 


UPPER A 


It 


S^peniih 


lA 


t 


I 


tt4l 


♦so 


R 73.6 


98 


1 15.8 


9 


It4t ♦UO 


R 79.8 


75 


1 21.4 


10 














V 73.4 


97 


I 35.6 


10 




V 89.0 


91 


1 38.6 


10 














G 76.8 


99 


m 10.2 


10 




G 79.4 


90 


BI 9.2 


9 














T 77.0 


99 


T 61.6 


10 




t 85.6 


89 


T 69.2 


10 






















MAR . H.S. 


FORM R 


t VRS. 


UPPER A 


II 


IPVench 


It 


t 


11 














IS47 ♦itO 


R 60.7 


90 


1 16.3 


9 






i. 


















V 79.2 


76 


D 28.8 


9 
























G 71.1 


86 


m 4.4 


7 
























T 77.2 


81 


T 49.5 


9 






















MAR. H.S. 


FORM Q 


• VRS. 


UPPER A 


II 


Spenith 


It 


t 


It 














IS47 ♦itO 


R 68.4 


61 


1 11.9 


8 
























V 72.4 


72 


D 26.2 


7 
























G 75.4 


91 


TO 5.3 


6 
























T 74.4 


80 


r 43.4 


7 






, 




OCT. 


tto 


FORM Q 


2 VRl. 


UPPER A 


It 


APR. SSO 


FORM 0 


S VRS. 


UPPER A 


It 


BpmiMh 


SA 


4 


t 


1149 




R 75.4 


84 


1 16.1 


8 


It4t 


R 79.4 


73 


1 18.4 


9 














V 85.9 


97 


1 26.1 


6 




V 92.3 


95 


D 35.1 


9 














G 76.9 


93 


M 5.2 


6 




G 79.8 


91 


IS 846 


9 














T 82.1 


95 


T 47.4 


7 




T 86.9 


91 


T 62.1 


10 






















MAR. SSO 


FORM 0 


S VRS. 


UPPER A 


1 1 




Si 


4 


4* 














IS47 


R 74.0 


52 


1 11.8 


5 
























V 93.0 


96 


D 27.5 


7 
























G 79.0 


90 


ID 4.8 


6 
























T 85.0 




T U.l 


7 










OCT. 


Its 


FORM R 


S VRS. 


UPPER A 


It 


APR. tto 


FORM R 


4 VRS. 


UPPER • 


It 


French 


4 


4 


S 


V»49 




R 91.3 


94 


I 21.0 


9 


lt4C 


R 98.3 


99 


1 10.3 


6 














V 82.0 


52 


I 35.7 


9 




V 86.7 


53 


I 20.3 


7 














G 76.7 


89 


M 8.3 


7 




G 70.0 


58 


m 8.7 


7 














T 87.0 


86 


T 65.04 


9 




T 88.7 


80 


T 39.3 


7 










OCT. 


Its 


FORM Q 


S VRS. 


UPPER A 


It 


APR. tto 


FORM 0 


4 VRS. 


UPPER A 


It 


Spoiieh 


4 


4 


t 


11149 




R 71.0 


40 


I 14.5 


7 


tt4t 


R 82.5 


63 


1 21.0 


10 














V 90.0 


92 


D 26.0 


6 




V 96.0 


93 


1 35.0 


9 














G 81.5 


94 


ID 6.0 


7 




G 78.5 


79 


M 8.5 


9 














T 83.5 


85 


T 46.5 


7 




T 89.0 


85 


T 64.5 


10 










MAR. 


tto 


INV. 


TENTH 


LOWER A 
















1 


t 


to 


1947 




R 18.0 


6 


I 9.3 


6 
























V 12.7 


5 


1 13.1 


5 












n 












G 16.0 


5 


m 14.0 


4 












U 












T 46.7 


5 


T 36.4 


5 












s 








OCT. 


tto 






LOWER A 




APR. 400 






UPPER A 




s 


SA 


t 


t 


tt4l 








I 13.2 


7 


tt4t 






I 10.7 


5 


















D 16.7 


7 








I 22.0 


5 


I 
















m 24.5 


8 








m 10.5 


7 


A 
















T 54.4 


8 








T 43.2 


6 


N 




















MAR. 400 


INV. 


TENTH 


UKPER A 






St 


t 


4 














tt47 


R 19.5 


6 


I 8.8 


4 
























V 17.5 


8 


D 18.5 


4 
























G 15.5 


S 


ID 1.5 


1 
























T 52.5 


6 


T 28.8 


2 



«1Vro of tko four foiltd to toko th^ Co-opcrstiTO toot. 

#Six nontM torlior thio group hod tuken • tryout forn of Aurul Upp«r A. 
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COLLEGE C 

June 1947 


HRS. 

PER 

GROUP WK. N 


, 

TOTAL CO-OPERATIVE AURAL 

KRS. MEAK %ILE MEAN TENTH 


Further Aural Notes 


Spanish 2 s 4 1 


13S FORM 0 2YRS. LOWER ■ 2 

R 60.7 31 I 8.7 4 

V 61.8 30 I 10.9 4 

G 61.2 44 HI 13.1 4 

T 62 6 35 T 32.7* 4 


Twenty-one of these (♦30.2) had j 
taken Aural Lower A at 9() hrs. i 
in JIan. 1947. Total mean: 
27.8 (5th tenth). 


French s s no 


ISO FORM P 2YRS. UPPER ■ 11 

R 69.6 61 I 6.0 6 

V 74.0 57 I 12.8 6 

G 65.7 69 M 4.8 6 

T 72.1 63 T 23.6 7 


;l 

) 


Sptdiish 3 3 113 


ISO FORM 0 2YRS. UPPER ■ 11 

R 67.9 59 I 10.7 5 

V 66.6 50 I 9.0 6 

G 65.9 64 M 6.7 5 

T 68.5 57 T J6.4* 6 


Eighty-four of these (♦25.9) had ^ 
taken Aural Lower A at 135 hrs* 
in Jan. 1947. Total mean: 
37.5 (6th tenth ) * 


French x4 9 is 


270 FORM P 2YRS. UPPER ■ 11 

R 75.7 80 I 12.2 10 

V 73.5 57 I 16.5 8 

G 66.5 69 m 6.2 7 

T 74.2 70 T 34.9 10 




%»nish x4 s is 


270 FORM 0 2YRS. UPPER > 11 

R 70.6 70 I 14.1 9 

V 67.7 54 1 17.1 10 

G 72.1 84 m 8.2 7 

T 72.2 72 T 39.4* 10 


Fourteen of these (*40.6) had 
taken Aural Lower A at 135 
hours in Jan* 1947. Total 
mean: 41.8 (9th tenth), 


Spanish 4 3 30 


229 FORM 0 3 YRS. 

R 67.1 26 

V 69.9 28 

G 60.4 26 

T 67.5 26 


This grouD took no auisi test in 
June 1947, but twenty of them 
had taken Aural Upper A at 180 
hrs. in Jan. 1947. Total mean: 
31.2 (4th tenth). 


French s s 4 7 


OVER FORM P 3 YRS. UPPER ■ 12 

*** R 79.3 66 I 10.9 6 

V 81.5 50 I 16.3 5 

G 74.0 83 M 6.8 5 

T81.1 68 T 34.0 6 




Spanish s 3 23 


OVER FORM 0 3 YRS. UPPER B 12 

R 73.4 50 I 13.0 4 

V 74.9 47 I 17.8 7 

G 70.9 67 m 8.8 5 

T 75.2 56 T 39.6* 6 


^twelve of these (♦37.2) had taken 
Aural Ibper A at 225 hours in w 
Jan. 1947. Total mean; 37.7 [ 
(5th tenth). 


Spanish • 34 


OVER FORM 0 3 YRS. UPPER B 12 

R 79.5 73 I 16.3 7 

V 85.8 85 I 19.3 7 

G 78.0 88 M 11.3 8 

T 84.0 85 T 46.8 8 


• \ 



IX designates Experimental Group. 



I 

/ 
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COLLEGE K 


' 

SROUP 


HRS. 

PER 

WX. 


N 


OATE 


TOTAL 

HRS. 


CO*OPERATIVE 
MEAN %ILE 


AURAL 

MEAN TENTH 


OATE 


TOTAL 

HRS. 


MEAN 


HILE 


MEAN 


tenth 


KT 








OEC. 


ISO 


rORM R 


« VR. 


LOWER A 


IS 


MAR. 


ISO 


FORM R 


1 VR. 


OFFER A 


11 


IP 


X*1 


IS 


1i 


1S4S 




R 41.1 


10 


I 2.4 


3 


1S4S 




R 65.1 


84 


1 4.8 


3 


R 












V SS.2 


32 


I 8.4 


3 






V 67.6 


80 


n 15.9 


S 


E 












G 53.4 


45 


n 8.9 


4 






G 60.2 


73 


U 2.6 


6 


N 












T 49.9 


25 


T 19.8 


4 






T 65.6 


82 


T 23.3 


3 


ip 








JUNE 


ISO 


FORM R 


1 VR. 


LOWER li 


IR 
















1 


s 


SO 


1S4S 




R 68.0 


90 


I 2.8 


4 














H 












V 70.4 


86 


I 11.9 


5 


























G 67.1 


91 


II 9.7 


5 


























T 71.1 


93 


T 24.4 


5 






















MAR. 


140 


FORM 0 


1 VR. 


LOWER A 


ID 


JUNE 


ISO 


FORM Q 


1 VR. 


UFFER A 


11*11 


G 


X. 1 


10 


14 


1S4| 




R 51. 1 


31 


I 7.4 


6 


1S4S 




R 56.1 


49 


I 6.6 


7 


1 IG> 












V 47.5 


18 


0 6.6 


5 






V 57.0 


53 


1 18.1 


7 


E 












G 52.6 


51 


m 8.6 


5 






G 56.9 


67 


M 7.9 


7 


1 R 








- 




T 50.3 


29 


T 22.6 


6 






T 57.1 


57 


T 32.6 


8 


M 








MAR. 


ISO 


FORM 0 


1 VR. 


LOWER A 


IS 














[' ^ 


1 


s 


40 


1S4S 




R 52.9 


38 


I 4.8 


5 














N 












V 50.5 


28 


11 4.4 


3 
























G 55.0 


59 


m 7.8 


5 














1 












T 53.0 


40 


T 17.0 


4 






















OEC. 


ISO 


FORM Q 


1 VR. 


LOWER A 


ID 


MAR. 


140 


FORM Q 


1 VR. 


UFFER A 


It 




X. 1 


10 


ts 


1S4S 




R 45.5 


19 


I 3.7 


4 


1S4S 




R 52.3 


43 


I 6.6 


4 


C 












V 40.5 


6 


n 8.0 


3 






V 46.7 


19 


I 18.4 


4 


S 












G 42.4 


14 


li 14.5 


6 






G 55.3 


61 


M 4.1 


5 


P 












T 42.2 


9 


T 26.2 


4 






T 51.7 


40 


T 29.2 


4 


A 








MAY 


ISO 


FORM Q 


« VR. 


LOWER A 


ID 














N 


1 


5 


7S 


1S4S 




R 64.7 


88 


I 5.2 


5 














IT 












V 65.0 


84 


1 11.2 


6 














I 












G 64.4 


90 


M 13.9 


6 














S 












T 66.5 


90 


T 30.3 


5 














H 




















OEC. 


4S0 


FORM Q 


Z VRS. 


UFFER A 


1 1 






10 


1 1 














1S4S 




R 67.6 


58 


I 13.5 


9 


























V 66.4 


48 


I 26.8 


7 


























G 68.7 


76 


M 3.5 


5 


























T 67.5 


56 


T 43.8 


8 



7 
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AN INVESTIGATION OF SECOND- LANGUAGE TEACHING 



I COLLEGE L 


HiKS. 

PER 

GROUP WKa N 


TOTAL co-operative AURAL 

OATE HRS. MEAN %\L£ MEAN TENTH 


French x-ia s is4 


APR. MO LOWER A 1R 

I 4.5 5 

I 12.2 6 

M 10.3 5 

T 27.0 6 


French ia s ss 


JULY MO LOWER A 18 

'*** I 4.2 5 

M 13.0 6 

11 10.6 6 

T 27.8 6 


Sptniish x-iA 5 


JAN. 1 10 LOWER A 18 

I 8.0 8 

n 12.4 6 

II 16.1 7 

1 T 36.5 8 


Spanish ia s 


JAN. iso lower a 18 

I 5.5 6 

I 10.1 5 

M 11.7 5 

T 27.3 5 


Fmich x-is 8 140 


MAR. MO PCRMR* 1 YR. lower A 18 

R 52.7 43 I 4.9 6 

V 56.7 39 1 10 0 4 

G 52.4 40 M 9.6 5 

T 54.3 39 T 24.5 5 


French m 5 i4i 


MAR. 110 FORM 1 YR . LOWER A 18 

R 56.7 57 I 4.3 5 

V 59.7 52 1 10.5 4 

G 57.6 65 B 10.5 5 

T 58.7 59 T 25.3 5 


Spanish x-ia s to 


MAR. 110 FORM 0 OR P* 1 YR . LOWER A 18 

R 60.2 74 I 6.7 7 

V 53.7 43 1 11.2 6 

G 53.7 57 H 15.3 6 

T 56.6 60 T 33.2 7 


Spanish 1 i s 287 


MAR. 110 FORM 0 OR P* 1 YR . LOWER A 18 

R 59.0 71 I 5.9 6 

V 52.9 39 1 10.7 6 

G 55.3 61 B 14.9 6 

T 56.4 56 T 31.5 7 



'^Elementary Form 



1 HRS. 

1 PER 

COLLEGE M Igroup wk. n 


total total co-operative aural 

DATE HRS. MEAN TENTH OATE HRS. MEAN HUE MEAN TENTH 


Germfiffi x-i • st 


MAR. 200 LOWER A 2 MAY 270 FORM 0 2 YRS. UPPER A 11-12 

I 14.1 9 R 71.4 66 I 9.5 8 

M 13.4 8 V 69.2 57 I 24.2 9 

B 14.6 7 G 78.3 94 B 7.6 7 

T 42.2 9 T 75.3 79 T 41.2 9 





COMPLETE TABLES OF SCORES FOR GROUPS ST DIED 
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Has. 
















COLLEGE 


N 




pca 






TOTAL 


CO-OPEaATIVE 


AU^^AL 




eaoup 


WK. 


N 


DATE 


Hat. 


MEAN 


S9LE 


MEAN TENTH 












MAY 


t40 


FORM R 


1 YR. 


LOWER A 


11 






X.tA 


ri 


ts 


1i4S 




R 57.7 


62 


I 5.7 


7 
















V 63.6 
G 58.2 


68 


1 11.1 


5 
















65 


9 8.0 


4 
















T 60.8 


67 


T 24.8* 


5 


1 










MAY 


tio 


FORMR 


tl YR. 


LOWER A 


la 






1A 


s 


fS 


fS4S 




R 63.7 


81 


I 3.2 


4 
















V 63.5 


68 


1 10.6 


5 
















G 63.3 


82 


D 5.4 


3 


F ^ 














T 64.9 


W) 


T 19.1 


3 


R 










MAY 


t4o 






LOWER A 


ii 


E 




X. te 


a 


tl 


U47 








I 4.5 


5 


N 


















1 13.2 


6 


















m 8.7 


5 


C 


















T 26.4 


6 


H . 










MAY 


ISO 






LOWER A 


HR 






la.i 


s 


XU 


1S47 








I 2.8 


4 




















R 9.2 


4 




















11 8.2 


4 




















T 20.2 


4 












MAY 


tso 






LOWER A 


ta 






la. t 


s 


nt 


1S47 








I 2.9 


4 




















n 11.2 


5 




















9 8.6 


5 




















T 22.7 5 



ttstinf took plaeo in ^ril 1946 at hra« Ike group 
was rataatad on aaaa fora in May (240 hrst ) and mada a total 



Man of 31,6 (8th tenth). 
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AN INVESTIGATION OF SECOND- LANGUAGE TEACHING 



HIGH 

SCHOOLS 


HRS. 

PER AURAL 

LANGUAGE WK. N DATE MEAN TENTH 




JAN. LOWER A 01 




French s io if 4 ? j ^ ^ g 


H 


1 9.7 6 


I 


M 6.2 5 


G 


T 20.0 6 




JAN. LOWER A OD 


a 

C 


(j 0 rnBn s lo it47 j ^ g 


H 


E l\l 8 


0 


M 14.8 9 


0 


T 32.5 9 


B ^ 


JAN. LOWER A OS 




Spanish 5 10 1 S 47 j g ^ 




I 12! 7 10 




M 13.8 8 




T 35.2 10 




AUG. LOWER A OS 


H 


French 20 20 is 4 » j ^ 


I 


II 8i6 5 


G 


M 6.6 6 


S H 


T 21.8 7 


C 


AUG. LOWER A OS 


H 


Spanish 20 25 it 4 s j ^,4 g 


0 


1 lo!o 8 


r 


m 15.1 9 


C) Li 


T 32.6 10 




JAN. LOWER A OA 


H 


Frenchla s t if 4 s »ji 21*1 7 




JUNE LOWER S 


S H 


it4i T 20.2 


c 


JAN. LOWER A OA 


H 

0 


French lb » • is 4 Sj ^^ 5 ^ 


0 


JUNE LOWER S 


D L 


13*4 . 



O 

ERIC 




Appendix C 



The Reliabilities and Internal Correlations 

of the Aural Tests 



inbe following figures are usually based on a sample of 200 
papers. Tlhis sample contains a proportional representation of 
the institutions furnishing students for any particular group, 
but a random selection from the papers of each school. When 
fewer than 200 papers were available by the time these 
computations were made, all the papers were used and the size 
of the group has been indicated. The students on whose scores 
these figures are based were all conventionally taught 
(non-experiiMental) except in the case of the Russian tests, 
where the very small number of cases made it desirable to 
include experimental students in order to secure the largest 
possible body of data. 

The reliabilities were computed by the use of odd-even 
split-halves, with the coefficient corrected by the Spearman- 
Brown formula. It is worth noting that, other things (such as 
the size of the samples) being equal, the reliability «coeffi- 
cients for any one test tend to increase along with greater 
training on the part of the students tested. 
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AN INVESTIGATION OF SECONO-LANGUAGE TEACHING 



FRENCH AURAL TEST 

College students with no high 
school French who had had 90° 
130 hours of college elementary 
instruction 



LOWER LEVEL FORM A 

College students taking inter- 
mediate or advanced college 
courses (Ns196) 





I 


n u 


Tot. 


I 


1 


n 


Tot. 


I 


. 65 






I .65 








I 


.42 


.77 




1 .48 


.75 






M 


.43 


.48 .73 




M .52 


.41 


.76 




Tot. 


.69 


.79 .84 


. 86 


Tot . . 78 


.76 


.83 


. 88 




FRENCH AURAL TEST — 


UPPER LEVEL 


FORM 


A 




College students with no high ^ 


, College students with 


various 


school 


French who were 


tested , 


amounts of high school 


French 


near the end 


of an intermediate 


who were tested in first part 


course 


(N=89) 






of intermediate course 






I 


n M 


Tot. 


T 


I 


n 


Tot. 


I 


.59 






I .76 








I 


.59 


.76 




I . 56 


.81 






M 


.38 


.54 .50 




m .34 


.41 


.46 




Tot. 


.81 


. 92 . 66 


.85 


Tot. .82 


.90 


. 56 


. 88 



College students with various 
amounts of high school French 
who were tested near the end 
of an intermediate course 

(N=181): 



College students taking an ad- 
vanced course (Nsl41) 





I 


H 


H Tot. 




I 


I 


m 


Tot. 

1 


i: 


.75 






I 


.83 






f 

!• 


1 '; 


.56 


.71 




1 


.69 


.86 




!( 

■1 


Ilf' 


.44 


. 36 


.30 


HI 


.51 


.63 


.71 


i 


Tot. 


.84 


.88 


.60 .82 


Tot. 


.85 


.94 


.75 


.92 



O ' ■ 

ERIC 









DATA ON AURAL TESTS 
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GERMAN AURAL TEST — LOWER LEVEL FORM A 



College students with no high 
school German who had had less 
than 90 hours of college ele- 
mentary instruction 



College students with no high 
school German who had had 90- 
130 hours of college elemen- 
tary instruction 



I 


I 

.70 


1 




H 


.60 


.53 




inr 


.48 


.50 


.70 


Tot. 


.80 


.79 


.84 



Tot. 



I 


s 


M 


Tot. 


.76 








.68 


.70 






.67 


.64 


.84 




.86 


.84 


.90 


.95 



College students taking inter> 
mediate or advanced college 
courses (Nsl52) 



GERMAN AURAL TEST 





I 




Iff 


Tot. 


I 


.76 








I 


.62 


.74 








.59 


.62 


.82 




Tot. 


. 84 


.84 


.88 


.89 


UPPER LEVEL 


FORM 


A 





College students taking intermediate 
or advanced college courses (N~83) 





I , 


H 


Iff 


Tot 


' I 


.58 








Ilf 


.60 


.86 






Iff 


.46 


.54 


.54 




Tot. 


.81 


.92 


.70 


.79 



er|c 



mmm 






"T‘ 
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AN INVESTIGATION OF SECOND- LANGUAGE TEACHING 



RUSSIAN AURAL TEST 



LOWER LEVEL FORM A 



College students taking elementary 
courses (N=155) 

I 1 M Tot. 

I .80 

1 .77 .79 

M .74 .68 . 87 

Tot. .91 .88 .92 .94 



RUSSIAN AURAL TEST 



UPPER LEVEL FORM A 



College students taking intermediate 
or advanced courses (Ns60) 

I 1 M Tot. 

I .74 

M . 54 . 83 

M .52 .72 .73 

Tot. .78 .92 .84 .88 



f 



II 




DATA ON AURAL TESTS 
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SPANISH AURAL TEST — LOWER LEVEL FORM A 



College students witii no high 
school Spanish who had had 90- 
130 hours of college elementary 
instruction 



College students with various 
amounts of high school Spanish 
taking an intermediate college 
course 





I 


1 


El Tot. 




I 


n 


M 


I 


.45 






II 


.41 






n 


.52 


.59 




n 


.54 


.65 




M 


.39 


.36 


.78 


M 


.47 


.45 


.79 


Tot. 


.74 


.75 


.82 .82 


Tot. 


.77 


.76 


.85 



College students taking inter- 
mediate oi advanced college 
courses 



I n H Tot. 

I .67 

I .66 .73 

II .59 .59 .80 

Tot. .85 .84 .87 .90 



O 

ERIC 
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AN INVESTIGATION OF SECOND- LANGUAGE TEACHING 



SPANISH AURAL TEST — UPPER LEVEL FORM A 



College atudenta with no high 
achool Spaniah who were teated 
near the end of an intermediate 
courae 

I ' 1 HI Tot. 

1 .50 

n .53 .72 

II .32 .34 .57 

Tot. .78 .89 .56 .76 



College atudenta with varioua 
amounta of high achool Spaniah 
who were teated in firat part 



of an intermediate 


courae 




I 


H 


M Tot, 


I 


.28 






n 


.31 


.68 




M 


.07 


.20 


.51 


Tot. 


.61 


.89 


.45 .73 



College atudenta with varioua 
amounta of high achool Spaniah 
who were teated near the end 
of an intermediate courae 

I |[ ]UI Xot. 

I .61 

I .55 .70 

M .41 .42 .40 

Tot. .81 .89 .63 .78 



College atudenta taking an ad» 
vanced courae 





I 


1 


HI 


I 


.80 






I 


.61 


.72 




M 


.47 


.32 


-.53 


Tot. 


.85 


.89 


.65 
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